Orbiter History

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 473.68224ms target: https://eu1.storj.io/login FAIL (2025-07-23 16:19:56 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 473.702018ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.860349085s FAIL (2025-07-23 16:19:31 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.860373082s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.790144498s FAIL (2025-07-23 16:18:58 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.790177089s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 472.075786ms target: https://eu1.storj.io/login FAIL (2025-07-23 16:18:46 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 472.105003ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.973038629s FAIL (2025-07-23 16:18:00 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.973064276s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 472.616149ms target: https://eu1.storj.io/login FAIL (2025-07-23 16:17:47 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 472.636708ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 476.64006ms target: https://eu1.storj.io/login FAIL (2025-07-23 16:17:23 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 476.670858ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.907290756s FAIL (2025-07-23 16:16:56 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.907311405s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.874681348s FAIL (2025-07-23 16:16:35 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.874710052s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 482.670888ms target: https://eu1.storj.io/login FAIL (2025-07-23 16:16:29 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 482.695876ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.928300779s FAIL (2025-07-23 16:15:59 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.928328553s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 154.438934ms target: https://eu1.storj.io/login FAIL (2025-07-23 16:15:42 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 154.469794ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.002633718s FAIL (2025-07-23 16:15:02 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.00266626s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.748658081s FAIL (2025-07-23 16:14:26 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.748683019s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.839008102s FAIL (2025-07-23 16:14:08 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.839037036s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.004693519s FAIL (2025-07-23 16:13:24 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.004723066s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.917411276s FAIL (2025-07-23 16:12:47 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.917442285s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.939082092s FAIL (2025-07-23 16:11:48 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.939105816s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.082624555s FAIL (2025-07-23 16:10:56 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.082650093s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.693751075s FAIL (2025-07-23 16:09:57 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.693778216s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.713750788s FAIL (2025-07-23 16:09:16 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.713781517s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.858619845s FAIL (2025-07-23 16:08:01 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.858646547s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.664838473s FAIL (2025-07-23 16:06:57 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.664869491s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.844899474s FAIL (2025-07-23 16:06:23 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.844925354s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.8024974s FAIL (2025-07-23 16:05:20 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.802525834s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.714800841s FAIL (2025-07-23 16:04:26 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.714830839s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.700336433s FAIL (2025-07-23 16:03:34 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.700368314s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.762361591s FAIL (2025-07-23 16:02:33 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.762388022s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.914391291s FAIL (2025-07-23 16:01:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.914415998s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.793686544s FAIL (2025-07-23 16:01:03 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.793716101s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.361261825s FAIL (2025-07-23 15:59:53 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.361290048s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.027310504s FAIL (2025-07-23 15:59:33 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.027337164s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.161097981s FAIL (2025-07-23 15:58:35 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.161130944s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.650855501s FAIL (2025-07-23 15:57:42 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.650877333s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.71612963s FAIL (2025-07-23 15:56:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.716154628s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.769784949s FAIL (2025-07-23 15:56:11 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.769818613s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.986530231s FAIL (2025-07-23 15:55:41 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.986556801s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.995921234s FAIL (2025-07-23 15:54:44 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.995958817s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.101253855s FAIL (2025-07-23 15:54:07 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.101279624s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.78191924s FAIL (2025-07-23 15:53:36 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.781948837s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.823136403s FAIL (2025-07-23 15:53:11 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.823171361s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.006593934s FAIL (2025-07-23 15:51:59 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.006621697s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.938603866s FAIL (2025-07-23 15:51:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.93862768s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.826782225s FAIL (2025-07-23 15:50:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.826810178s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.849856966s FAIL (2025-07-23 15:49:27 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.849884259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.683566546s FAIL (2025-07-23 15:48:41 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.683890665s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.768868737s FAIL (2025-07-23 15:48:00 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.768901769s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.742498742s FAIL (2025-07-23 15:47:10 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.742534009s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002261633s FAIL (2025-07-23 15:46:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 30.002285528s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.270091556s FAIL (2025-07-23 13:51:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.270116281s edge gateway us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)