Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.914391291s FAIL (2025-07-23 16:01:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.914415998s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.793686544s FAIL (2025-07-23 16:01:03 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.793716101s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.361261825s FAIL (2025-07-23 15:59:53 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.361290048s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.027310504s FAIL (2025-07-23 15:59:33 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.027337164s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.161097981s FAIL (2025-07-23 15:58:35 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.161130944s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.650855501s FAIL (2025-07-23 15:57:42 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.650877333s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.71612963s FAIL (2025-07-23 15:56:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.716154628s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.769784949s FAIL (2025-07-23 15:56:11 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.769818613s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.986530231s FAIL (2025-07-23 15:55:41 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.986556801s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.995921234s FAIL (2025-07-23 15:54:44 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.995958817s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.101253855s FAIL (2025-07-23 15:54:07 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.101279624s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.78191924s FAIL (2025-07-23 15:53:36 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.781948837s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.823136403s FAIL (2025-07-23 15:53:11 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.823171361s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.006593934s FAIL (2025-07-23 15:51:59 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 6.006621697s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.938603866s FAIL (2025-07-23 15:51:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.93862768s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.826782225s FAIL (2025-07-23 15:50:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.826810178s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.849856966s FAIL (2025-07-23 15:49:27 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.849884259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.683566546s FAIL (2025-07-23 15:48:41 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.683890665s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.768868737s FAIL (2025-07-23 15:48:00 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.768901769s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.742498742s FAIL (2025-07-23 15:47:10 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 5.742534009s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002261633s FAIL (2025-07-23 15:46:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments... Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil> Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments... Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment... Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment. Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece... Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments... Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil> Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces. Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments... Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil> Duration: 30.002285528s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.270091556s FAIL (2025-07-23 13:51:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.270116281s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.002778178s FAIL (2025-07-23 13:51:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.002798938s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.311418145s FAIL (2025-07-23 13:50:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.311472789s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.256287318s FAIL (2025-07-23 13:50:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.256308979s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.13679128s FAIL (2025-07-23 13:49:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.136813664s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.214211516s FAIL (2025-07-23 13:48:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.214236254s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.900929658s FAIL (2025-07-23 13:47:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.900950028s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.917941028s FAIL (2025-07-23 13:46:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.917961187s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.909796624s FAIL (2025-07-23 13:46:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.909847671s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.137535537s FAIL (2025-07-23 13:44:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.137610282s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.82749419s FAIL (2025-07-23 13:44:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.827519558s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.44099082s FAIL (2025-07-23 13:43:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.441011308s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.28605723s FAIL (2025-07-23 13:42:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.28607845s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.202628507s FAIL (2025-07-23 13:41:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.2026459s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.............X.............................................] duration: 6.486525793s FAIL (2025-07-23 13:40:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.486546964s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [XX.............X............................................] duration: 5.874771043s FAIL (2025-07-23 13:39:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.87480582s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.XX.............X...........................................] duration: 6.098495033s FAIL (2025-07-23 13:38:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.098528217s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.XX.............X..........................................] duration: 6.934579457s FAIL (2025-07-23 13:38:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.934598324s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.XX.............X.........................................] duration: 6.438803642s FAIL (2025-07-23 13:37:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.438825413s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.XX.............X........................................] duration: 6.169525321s FAIL (2025-07-23 13:36:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.169549296s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.XX.............X.......................................] duration: 6.04626327s FAIL (2025-07-23 13:35:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.046283439s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.XX.............X......................................] duration: 6.133433875s FAIL (2025-07-23 13:34:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.133461558s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.XX.............X.....................................] duration: 6.30068374s FAIL (2025-07-23 13:33:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.300699629s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.XX.............X....................................] duration: 5.904228629s FAIL (2025-07-23 13:32:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.904252434s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.XX.............X...................................] duration: 6.174198783s FAIL (2025-07-23 13:32:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.174218121s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X.XX.............X..................................] duration: 6.198458377s FAIL (2025-07-23 13:31:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.198510756s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X.XX.............X.................................] duration: 6.180252923s FAIL (2025-07-23 13:31:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.180532388s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X.XX.............X................................] duration: 6.322030695s FAIL (2025-07-23 13:30:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.322045112s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.XX.............X...............................] duration: 6.935735953s FAIL (2025-07-23 13:29:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.935921527s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)