Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.938438052s FAIL (2025-09-07 08:17:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.938464273s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.518617414s FAIL (2025-09-07 08:16:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.518638565s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 10.036487863s FAIL (2025-09-07 08:15:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 10.036517039s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.66232186s FAIL (2025-09-07 08:15:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.662355815s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 7.046773878s FAIL (2025-09-07 08:14:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 7.046802844s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.676778581s FAIL (2025-09-07 08:13:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.676808247s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 12.188157531s FAIL (2025-09-07 08:12:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 12.188187729s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 8.945338065s FAIL (2025-09-07 08:12:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 8.945365708s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 7.76781688s FAIL (2025-09-07 08:11:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 7.767846055s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 10.136400892s FAIL (2025-09-07 08:09:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 10.136429125s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.919509002s FAIL (2025-09-07 08:08:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.919538388s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 7.441198737s FAIL (2025-09-07 08:08:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 7.441228395s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 7.603079637s FAIL (2025-09-07 08:07:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 7.603103693s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 8.568046506s FAIL (2025-09-07 08:07:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 8.568070952s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 8.434160026s FAIL (2025-09-07 08:06:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 8.434208328s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 15.515261409s FAIL (2025-09-07 08:05:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 15.5153036s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.48880935s FAIL (2025-09-07 08:04:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.488836092s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 7.220970459s FAIL (2025-09-07 08:03:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 7.220995728s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 9.042190432s FAIL (2025-09-07 08:02:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 9.042222144s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 7.061363482s FAIL (2025-09-07 08:02:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 7.06138338s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.444596419s FAIL (2025-09-07 08:01:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.444627299s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 12.689338367s FAIL (2025-09-07 08:00:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 12.689360409s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 14.732501936s FAIL (2025-09-07 08:00:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 14.73253027s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.2339884s FAIL (2025-09-07 07:58:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.234004371s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 9.2804317s FAIL (2025-09-07 07:58:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 9.280461867s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.403912406s FAIL (2025-09-07 07:57:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.403944627s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 7.364525365s FAIL (2025-09-07 07:56:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 7.3645428s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 7.467595563s FAIL (2025-09-07 07:55:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 7.46762538s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 8.119884694s FAIL (2025-09-07 07:54:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 8.119908638s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 23.760778398s FAIL (2025-09-07 07:54:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 23.760811452s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 9.554013726s FAIL (2025-09-07 07:53:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 9.554032952s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.392701645s FAIL (2025-09-07 07:53:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.392731983s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.89647533s FAIL (2025-09-07 07:52:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.896502913s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 12.143650636s FAIL (2025-09-07 07:51:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 12.143678991s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 8.174123882s FAIL (2025-09-07 07:50:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 8.174153618s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 8.566804822s FAIL (2025-09-07 07:49:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 8.566838698s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 21.36096748s FAIL (2025-09-07 07:49:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 21.36099388s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 9.363269664s FAIL (2025-09-07 07:48:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 9.36329419s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 19.739469275s FAIL (2025-09-07 07:47:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 19.739499973s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.588077646s FAIL (2025-09-07 07:47:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.588116299s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X..................................................X........] duration: 5.967886526s FAIL (2025-09-07 07:46:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 5.967916503s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X..................................................X.......] duration: 6.476093146s FAIL (2025-09-07 07:46:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 6.476118754s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X..................................................X......] duration: 11.235297147s FAIL (2025-09-07 07:45:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 11.235325952s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X..................................................X.....] duration: 5.982173674s FAIL (2025-09-07 07:44:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 5.982205754s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X..................................................X....] duration: 10.437349463s FAIL (2025-09-07 07:43:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 10.437372495s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X..................................................X...] duration: 22.287999745s FAIL (2025-09-07 07:43:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 22.288026918s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X..................................................X..] duration: 20.430394982s FAIL (2025-09-07 07:42:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 20.430420691s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X..................................................X.] duration: 11.788239804s FAIL (2025-09-07 07:41:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 11.788266004s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X..................................................X] duration: 30.00266681s FAIL (2025-09-07 07:41:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:41:00.880068262 (18h12m36.919641382s) [upload=16042]: Starting upload Sep 7 07:41:00.880121434 (18h12m36.919694554s) [upload=16042]: Done starting upload Sep 7 07:41:00.880222507 (18h12m36.919795627s) [upload=16042]: Uploading segments... Sep 7 07:41:00.880481883 (18h12m36.920055004s) [upload=16042]: Got next segment. Inline: false Sep 7 07:41:00.880554542 (18h12m36.920127662s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:41:00.880560424 (18h12m36.920133544s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:41:01.142388635 (18h12m37.181961755s) [seg_pos={0 0}, upload=16042]: Begin upload segment... Sep 7 07:41:01.142446266 (18h12m37.182019386s) [seg_pos={0 0}, upload=16042]: Done begin upload segment. Sep 7 07:41:01.142478026 (18h12m37.182051156s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142532150 (18h12m37.18210527s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142851541 (18h12m37.182424671s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.142855659 (18h12m37.182428779s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143146756 (18h12m37.182719876s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143177375 (18h12m37.182750495s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143440809 (18h12m37.183013929s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143446470 (18h12m37.18301959s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143693543 (18h12m37.183266663s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143698011 (18h12m37.183271141s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143965733 (18h12m37.183538864s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.143978057 (18h12m37.183551177s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144191876 (18h12m37.183765006s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144218928 (18h12m37.183792058s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.144473896 (18h12m37.184047026s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:01.145008158 (18h12m37.184581288s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Uploading piece... Sep 7 07:41:03.003551206 (18h12m39.043124326s) [upload=16042]: Next returned nil segment Sep 7 07:41:03.003570874 (18h12m39.043143994s) [upload=16042]: Waiting for error group managing segments... Sep 7 07:41:03.300382469 (18h12m39.339955589s) [noise=true , address=45.91.116.12:4225 , piece_id=AYAL4WFJYV5LUPDCE5IWPJQ7ICKMR3BH2JCLWSGHV6WK56A44J3Q, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.307947564 (18h12m39.347520684s) [noise=true , address=77.90.31.14:4661 , piece_id=GYN62ACDOG3WSULMGGD2VQKZRYDEUYZ3IHJP5VFWKSDLD7XBI2CA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312276949 (18h12m39.351850069s) [noise=true , address=45.91.116.10:4082 , piece_id=GIJ7S54KL6JX6JAWQ6BU4JOEVBWHDN6MWLOUIJ3ERFUXEW2RN74A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.312318097 (18h12m39.351891227s) [noise=true , address=77.90.31.18:4807 , piece_id=FJH57L4IIUKLU2QHK7MUPJLKBCX55PLUNYCZCEURK2XYUPQ62VAQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.327195766 (18h12m39.366768886s) [noise=true , address=45.91.116.8:4047 , piece_id=OL3LYUPGUEQM37EBZNRJB6K3EDPJRZFAIEPAQ2SUCHT43DNDUSVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.367796909 (18h12m39.407370029s) [noise=true , address=77.90.31.10:4517 , piece_id=EEXTVCT7RU434VCEUWAMTZTDGC46VJ3A4KPJYGOVCGDD7PPPRPVA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.368626887 (18h12m39.408200007s) [noise=true , address=45.91.116.4:4938 , piece_id=NB4RY3DWREIUSOFAJG2WYAO5XUEPPXZTJX62K2KFZBOEKKY4GBCQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.384673102 (18h12m39.424246222s) [noise=true , address=77.90.31.12:4592 , piece_id=AUIGYVOWCVFEDK5RTNBCTK26NHQQICDMBHEEXQKVODE5YRMJONSA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.386948507 (18h12m39.426521627s) [noise=true , address=45.91.116.12:4227 , piece_id=EZKVBDZSQQP5XHKKPYE4BK2IL4CLKO2KYOJMDXU4ACGDVSF5MYDQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.387440909 (18h12m39.427014029s) [noise=true , address=45.91.116.11:4119 , piece_id=LSLVWIKHIL6RXF52EYI3J5TJMBSWXL7KU24UTSXDNBN2HAKIE3MQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.406867773 (18h12m39.446440913s) [noise=true , address=45.91.116.10:4083 , piece_id=UO5R2ZKOR2HPRF3ZTQVAVY7UV4WZJG5IH7ELFXSGLNOSGVHYQQVQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.417163625 (18h12m39.456736765s) [noise=true , address=77.90.31.16:4733 , piece_id=2K25Z6XEWXPLH7THBGDVETEY3S5FG5AZJWDIW7QXONONXRHNGC6A, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427665210 (18h12m39.467238341s) [noise=true , address=77.90.31.15:4697 , piece_id=CGHIJVYT7EAKM6UOBU3KZSAEOYG67OSLD3E4F3VBM3UEMKK7UINA, seg_pos={0 0}, upload=16042]: Done uploading piece. err: <nil> Sep 7 07:41:03.427689336 (18h12m39.467262476s) [seg_pos={0 0}, upload=16042]: Segment reached optimal threshold of 13 pieces. Sep 7 07:41:03.427834134 (18h12m39.467407254s) [noise=true , address=45.91.116.4:4939 , piece_id=N53LKQWFYAS7DCNYDKF3BU7HFE5XYZWVMFDD7JKPZ5REEDTHQ3TQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 7 07:41:03.428062240 (18h12m39.46763536s) [noise=true , address=77.90.31.21:4878 , piece_id=ZP42B6ME3WN372SWXFWP3Y2HXXYZ5J5GHALRNI3U4VKHPMRVNCMQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56592->77.90.31.21:4878: use of closed network connection Sep 7 07:41:03.428109731 (18h12m39.467682851s) [noise=true , address=77.90.31.15:4698 , piece_id=WIJ4QFWN7MUNQC6YX5QQSM7BAZ6ZFHD5LLEG6OOZXPTS5GCYRQEQ, seg_pos={0 0}, upload=16042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj): protocol: read tcp 188.166.225.170:52146->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 7 07:41:03.428135871 (18h12m39.467708991s) [seg_pos={0 0}, upload=16042]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:41:03.428233657 (18h12m39.467806777s) [upload=16042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:41:03.428238518 (18h12m39.467811638s) [upload=16042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:41:03.750337730 (18h12m39.789910851s) [upload=16042]: Done uploading segments... Sep 7 07:41:03.750357549 (18h12m39.789930669s) [upload=16042]: Upload finished. err: <nil> Duration: 30.002692158s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.437790243s FAIL (2025-09-07 07:40:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 7 07:01:47.066329013 (17h33m23.105902133s) [upload=15464]: Starting upload Sep 7 07:01:47.066438282 (17h33m23.106011402s) [upload=15464]: Done starting upload Sep 7 07:01:47.066728557 (17h33m23.106301677s) [upload=15464]: Uploading segments... Sep 7 07:01:47.066797369 (17h33m23.106370489s) [upload=15464]: Got next segment. Inline: false Sep 7 07:01:47.066878965 (17h33m23.106452085s) [upload=15464]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 7 07:01:47.066884956 (17h33m23.106458077s) [upload=15464]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 7 07:01:47.342943755 (17h33m23.382516875s) [seg_pos={0 0}, upload=15464]: Begin upload segment... Sep 7 07:01:47.342992036 (17h33m23.382565176s) [seg_pos={0 0}, upload=15464]: Done begin upload segment. Sep 7 07:01:47.343023898 (17h33m23.382597018s) [noise=true , address=45.91.116.6:4974 , piece_id=3CMPKPU25N6VSHBJN3AEAJSCXQ5TYCDMSFKNZ2CFTQHVKJBSJLYA, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.343052483 (17h33m23.382625603s) [noise=true , address=45.91.116.14:4191 , piece_id=P7BD7E4U7XMD3JTSRVVP57QKZDIU3WTZTISKUVTJSVTUEAJVLIIA, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.343519717 (17h33m23.383092837s) [noise=true , address=45.91.116.11:4118 , piece_id=2BBVSJIHO6FPXW23DYGYSSPL5WBL6U4246PRPZLGQI6RLZFNVXKQ, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.343947926 (17h33m23.383521046s) [noise=true , address=77.90.31.10:4520 , piece_id=MHB7E3LZMBV5MAHSQL4ZFPYYOTZWEX45ZDR5J5PZFKZ7XG3EZBMQ, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.344065361 (17h33m23.383638481s) [noise=true , address=45.91.116.9:4262 , piece_id=OQ6ZIQ6GAUREJG22HS2CC6T2MHCFUPVBQ44HWPQU2WOEPIBWBMZA, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.344242830 (17h33m23.38381595s) [noise=true , address=45.91.116.6:4973 , piece_id=J2QNLMKPDHUL7VCZSISJQRUOVHND4ZO37U5CDSUAMCWTEYKY733Q, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.344368250 (17h33m23.38394136s) [noise=true , address=45.91.116.4:4939 , piece_id=TQ4PR4FEQ7SSY37TEWBJKHDMSAWFJN4CLWNFF25PLFRWMODDTG7A, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.344625502 (17h33m23.384198622s) [noise=true , address=77.90.31.19:4841 , piece_id=4266B3PL7KY5QBQN2SETNFQII7PVPGDQ44Y4O7XGABNWQNR7ZXEA, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.344887113 (17h33m23.384460233s) [noise=true , address=77.90.31.12:4590 , piece_id=XRDFOX3JZHELYNNU6SGB7FMRUK676ZE2SXMX2FWCM47HNJ4EKFOA, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.345137953 (17h33m23.384711073s) [noise=true , address=77.90.31.15:4697 , piece_id=A4GAE67UMM36RWNB45L3II6WZ34XY5N5JRLLBIKAJ2MZCE6UXQQA, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.345219910 (17h33m23.38479303s) [noise=true , address=45.91.116.12:4225 , piece_id=YCOU7JWILAGDJISDTSFEQ2B5TCKCKQXAJBEMKQQEYLJMQRMXQCIQ, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.345494946 (17h33m23.385068066s) [noise=true , address=45.91.116.13:4154 , piece_id=DBL2SO64I3Q6W7IITKS27K75RLXKD4VJYJ3HVSPQCFCRRO3DVQHA, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.345746427 (17h33m23.385319547s) [noise=true , address=45.91.116.10:4081 , piece_id=AFB4CREDY6GZM6DUWK32N7U2ZTIXRKYNVQ774FBXZYPERN5SVIVQ, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.346049958 (17h33m23.385623078s) [noise=true , address=45.91.116.8:4045 , piece_id=S4L3SASDFUJ6YZGAQFWZ6U43R7HPCB6TRHGP2GIIRZQYC4OJIU6A, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.346123429 (17h33m23.385696549s) [noise=true , address=45.91.116.14:4190 , piece_id=372SYY5VAUVKGNLCV7QJBMKHTEV7MYI7357UWGZJWN53AXWHAY5A, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:47.346399417 (17h33m23.385972537s) [noise=true , address=45.91.116.5:4299 , piece_id=VVRXDMLBSJY7FGZZOMK6J5553HJKXTVXGL3WY6A52ZV2M33MP7KA, seg_pos={0 0}, upload=15464]: Uploading piece... Sep 7 07:01:49.133385953 (17h33m25.172959103s) [upload=15464]: Next returned nil segment Sep 7 07:01:49.133409047 (17h33m25.172982167s) [upload=15464]: Waiting for error group managing segments... Sep 7 07:01:49.468594589 (17h33m25.508167709s) [noise=true , address=45.91.116.13:4154 , piece_id=DBL2SO64I3Q6W7IITKS27K75RLXKD4VJYJ3HVSPQCFCRRO3DVQHA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.476449229 (17h33m25.516022349s) [noise=true , address=77.90.31.19:4841 , piece_id=4266B3PL7KY5QBQN2SETNFQII7PVPGDQ44Y4O7XGABNWQNR7ZXEA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.502211056 (17h33m25.541784176s) [noise=true , address=45.91.116.12:4225 , piece_id=YCOU7JWILAGDJISDTSFEQ2B5TCKCKQXAJBEMKQQEYLJMQRMXQCIQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.504739675 (17h33m25.544312795s) [noise=true , address=45.91.116.14:4191 , piece_id=P7BD7E4U7XMD3JTSRVVP57QKZDIU3WTZTISKUVTJSVTUEAJVLIIA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.532999131 (17h33m25.572572251s) [noise=true , address=45.91.116.4:4939 , piece_id=TQ4PR4FEQ7SSY37TEWBJKHDMSAWFJN4CLWNFF25PLFRWMODDTG7A, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.551845716 (17h33m25.591418836s) [noise=true , address=77.90.31.12:4590 , piece_id=XRDFOX3JZHELYNNU6SGB7FMRUK676ZE2SXMX2FWCM47HNJ4EKFOA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.574766857 (17h33m25.614339977s) [noise=true , address=45.91.116.6:4974 , piece_id=3CMPKPU25N6VSHBJN3AEAJSCXQ5TYCDMSFKNZ2CFTQHVKJBSJLYA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.624577273 (17h33m25.664150383s) [noise=true , address=45.91.116.10:4081 , piece_id=AFB4CREDY6GZM6DUWK32N7U2ZTIXRKYNVQ774FBXZYPERN5SVIVQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.632346711 (17h33m25.671919831s) [noise=true , address=77.90.31.15:4697 , piece_id=A4GAE67UMM36RWNB45L3II6WZ34XY5N5JRLLBIKAJ2MZCE6UXQQA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.638454468 (17h33m25.678027588s) [noise=true , address=77.90.31.10:4520 , piece_id=MHB7E3LZMBV5MAHSQL4ZFPYYOTZWEX45ZDR5J5PZFKZ7XG3EZBMQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.643637416 (17h33m25.683210536s) [noise=true , address=45.91.116.8:4045 , piece_id=S4L3SASDFUJ6YZGAQFWZ6U43R7HPCB6TRHGP2GIIRZQYC4OJIU6A, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.685603080 (17h33m25.7251762s) [noise=true , address=45.91.116.14:4190 , piece_id=372SYY5VAUVKGNLCV7QJBMKHTEV7MYI7357UWGZJWN53AXWHAY5A, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.702167948 (17h33m25.741741068s) [noise=true , address=45.91.116.9:4262 , piece_id=OQ6ZIQ6GAUREJG22HS2CC6T2MHCFUPVBQ44HWPQU2WOEPIBWBMZA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: <nil> Sep 7 07:01:49.702193938 (17h33m25.741767058s) [seg_pos={0 0}, upload=15464]: Segment reached optimal threshold of 13 pieces. Sep 7 07:01:49.702392338 (17h33m25.741965459s) [noise=true , address=45.91.116.6:4973 , piece_id=J2QNLMKPDHUL7VCZSISJQRUOVHND4ZO37U5CDSUAMCWTEYKY733Q, seg_pos={0 0}, upload=15464]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: write tcp 188.166.225.170:44728->45.91.116.6:4973: use of closed network connection; write tcp 188.166.225.170:44728->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44728->45.91.116.6:4973: use of closed network connection Sep 7 07:01:49.702397548 (17h33m25.741970668s) [noise=true , address=45.91.116.5:4299 , piece_id=VVRXDMLBSJY7FGZZOMK6J5553HJKXTVXGL3WY6A52ZV2M33MP7KA, seg_pos={0 0}, upload=15464]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Sep 7 07:01:49.702517978 (17h33m25.742091098s) [noise=true , address=45.91.116.11:4118 , piece_id=2BBVSJIHO6FPXW23DYGYSSPL5WBL6U4246PRPZLGQI6RLZFNVXKQ, seg_pos={0 0}, upload=15464]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: context canceled; context canceled Sep 7 07:01:49.702546904 (17h33m25.742120024s) [seg_pos={0 0}, upload=15464]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 7 07:01:49.702628149 (17h33m25.742201269s) [upload=15464]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 7 07:01:49.702632918 (17h33m25.742206038s) [upload=15464]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 7 07:01:50.096494792 (17h33m26.136067902s) [upload=15464]: Done uploading segments... Sep 7 07:01:50.096524448 (17h33m26.136097568s) [upload=15464]: Upload finished. err: <nil> Duration: 6.437821101s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)