Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
472.61374ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:35:49 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 472.639188ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
481.250482ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:34:52 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 481.272534ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
483.159297ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:34:10 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 483.188002ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
480.53153ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:33:15 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 480.572498ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
476.485568ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:32:19 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 476.507381ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
479.566042ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:31:55 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 479.589245ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.788592431s
FAIL (2025-07-23 16:31:18 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.788613782s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
466.781871ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:30:55 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 466.797823ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
546.699934ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:30:32 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 546.727126ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.759812314s
FAIL (2025-07-23 16:30:16 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.759866116s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
471.71402ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:29:31 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 471.739398ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.740417693s
FAIL (2025-07-23 16:29:13 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.740447591s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
473.161318ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:28:34 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 473.185845ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.79960504s
FAIL (2025-07-23 16:28:33 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.799630489s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.808107367s
FAIL (2025-07-23 16:28:15 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.808136263s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.802403164s
FAIL (2025-07-23 16:27:55 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.802428982s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
483.572961ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:27:40 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 483.599351ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
474.38502ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:27:11 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 474.406ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.836068877s
FAIL (2025-07-23 16:27:02 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.836106299s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.848761061s
FAIL (2025-07-23 16:26:31 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.848788544s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
474.36423ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:26:06 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 474.406432ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.824764108s
FAIL (2025-07-23 16:25:50 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.824787313s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.939730929s
FAIL (2025-07-23 16:25:09 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.939763392s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
477.259308ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:25:02 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 477.280279ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.977521186s
FAIL (2025-07-23 16:24:39 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.977551424s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
479.097175ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:24:25 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 479.124909ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.112100215s
FAIL (2025-07-23 16:23:44 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 6.112125634s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
479.554366ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:23:21 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 479.580968ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
5.784445426s
FAIL (2025-07-23 16:23:13 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.784463209s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.187648154s
FAIL (2025-07-23 16:22:29 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 6.187680144s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
471.122291ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:22:11 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 471.144073ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.738347583s
FAIL (2025-07-23 16:21:23 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.73837301s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
481.236634ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:21:10 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 481.260519ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
6.04445783s
FAIL (2025-07-23 16:20:54 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 6.044484129s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.849279421s
FAIL (2025-07-23 16:20:27 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.849309809s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
473.68224ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:19:56 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 473.702018ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.860349085s
FAIL (2025-07-23 16:19:31 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.860373082s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
5.790144498s
FAIL (2025-07-23 16:18:58 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.790177089s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
472.075786ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:18:46 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 472.105003ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.973038629s
FAIL (2025-07-23 16:18:00 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.973064276s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
472.616149ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:17:47 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 472.636708ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
476.64006ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:17:23 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 476.670858ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.907290756s
FAIL (2025-07-23 16:16:56 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.907311405s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.874681348s
FAIL (2025-07-23 16:16:35 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.874710052s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
482.670888ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:16:29 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 482.695876ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.928300779s
FAIL (2025-07-23 16:15:59 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.928328553s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
154.438934ms target:
https://eu1.storj.io/login
FAIL (2025-07-23 16:15:42 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused
Duration: 154.469794ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
6.002633718s
FAIL (2025-07-23 16:15:02 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 6.00266626s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.748658081s
FAIL (2025-07-23 16:14:26 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.748683019s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.839008102s
FAIL (2025-07-23 16:14:08 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
iece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Jul 23 15:45:23.369666369 (112h54m29.742245724s) [seg_pos={0 0}, upload=90242]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:45:23.369758966 (112h54m29.742338321s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:45:23.369764056 (112h54m29.742343411s) [upload=90242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:45:23.684495083 (112h54m30.057074438s) [upload=90242]: Done uploading segments...
Jul 23 15:45:23.684512747 (112h54m30.057092102s) [upload=90242]: Upload finished. err: <nil>
Jul 23 15:46:11.264846280 (112h55m17.637425635s) [upload=90253]: Starting upload
Jul 23 15:46:11.264906325 (112h55m17.63748568s) [upload=90253]: Done starting upload
Jul 23 15:46:11.264952603 (112h55m17.637531958s) [upload=90253]: Uploading segments...
Jul 23 15:46:11.265104123 (112h55m17.637683469s) [upload=90253]: Got next segment. Inline: false
Jul 23 15:46:11.265132969 (112h55m17.637712324s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 23 15:46:11.265137828 (112h55m17.637717183s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 23 15:46:11.502715894 (112h55m17.87529529s) [seg_pos={0 0}, upload=90253]: Begin upload segment...
Jul 23 15:46:11.502770769 (112h55m17.875350145s) [seg_pos={0 0}, upload=90253]: Done begin upload segment.
Jul 23 15:46:11.502785027 (112h55m17.875364422s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.502795096 (112h55m17.875374451s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.503514954 (112h55m17.876094349s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504049216 (112h55m17.876628581s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504302400 (112h55m17.876881765s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504478558 (112h55m17.877057923s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.504701164 (112h55m17.877280529s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505063717 (112h55m17.877643072s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505399990 (112h55m17.877979345s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505566379 (112h55m17.878145734s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.505905087 (112h55m17.878484442s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506205452 (112h55m17.878784807s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506307797 (112h55m17.878887162s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506617531 (112h55m17.879196886s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.506954786 (112h55m17.879534141s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:11.507046891 (112h55m17.879626257s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Uploading piece...
Jul 23 15:46:13.166708723 (112h55m19.539288078s) [upload=90253]: Next returned nil segment
Jul 23 15:46:13.166747807 (112h55m19.539327162s) [upload=90253]: Waiting for error group managing segments...
Jul 23 15:46:13.558371548 (112h55m19.930950903s) [noise=true , address=45.91.116.11:4117 , piece_id=TN7YPQBL5G4O7J6C5ZNXXOERH7WWWME4XNOFFJFI4BCFKH7KRMOQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.559425875 (112h55m19.93200523s) [noise=true , address=45.91.116.12:4227 , piece_id=67JIIQGAG4Y5JZLA2SDBM23FYY3KMBPO4LIP73AE7UGARYCYGHRA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.560667410 (112h55m19.933246755s) [noise=true , address=45.91.116.4:4939 , piece_id=FOECKDX4DV4QYVPL7VMCPZHK3UJWWESPRKP7IPH3ET4PIR52F5BQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.564802282 (112h55m19.937381637s) [noise=true , address=104.36.82.16:4293 , piece_id=Z6EO3XK6PLLW74UZUOCX7NKX46LJFLEKZ5PTW3M5NOYT3FQHDPWA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581002689 (112h55m19.953582044s) [noise=true , address=77.90.31.11:4554 , piece_id=S7R3AAJQ3SLLY43J3H5CZPVYGOBIKFWVAHJTVQRVVKCUJIGUBTJQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.581204114 (112h55m19.953783509s) [noise=true , address=45.91.116.14:4191 , piece_id=PFJLHBRQLKLZRPBUKHPC2OP4225HMETQU46O43QQ3M4M7FGN34JA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591592861 (112h55m19.964172216s) [noise=true , address=77.90.31.16:4733 , piece_id=BYLPZ47WIODFXNZHL6HTQAN4CF2V4WF6NYPXDRICKFDED3YIEVTA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.591996944 (112h55m19.964576299s) [noise=true , address=77.90.31.21:4879 , piece_id=YLNFT5LAPICS2TIZATQYTWJSGNN3Z6NEKQUQQCHN2H4OC3CHHBEQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.594057186 (112h55m19.966636541s) [noise=true , address=77.90.31.18:4807 , piece_id=32UIK5U7WAYNEYWUCALG4TVTBRRTY2VHE2SST4LJR46Q6OMBTU7Q, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.598730748 (112h55m19.971310113s) [noise=true , address=77.90.31.14:4663 , piece_id=AP6QLJDYIADD6LLZ5PX6DYYLUMG7VHL43X4QNHR6R2AZOGZQXGXQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.607153805 (112h55m19.97973316s) [noise=true , address=77.90.31.17:4772 , piece_id=NHZWB47DWAOCBERMBOO2WWGFXC75KMDCPVCYUFL5YVKIKRYSUWBA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.609757325 (112h55m19.98233668s) [noise=true , address=45.91.116.13:4153 , piece_id=YLQI4ENFF7QCO6DFMGNRLFFFNDDCYZPUXGCJV65E2NGRIGFPFHCA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633775621 (112h55m20.006354976s) [noise=true , address=104.36.82.8:4971 , piece_id=TZWX7TRMN2TSXQHQKDDYNYFAYYW56ACMROA4P3PY7FXFFIT5XKFQ, seg_pos={0 0}, upload=90253]: Done uploading piece. err: <nil>
Jul 23 15:46:13.633825086 (112h55m20.006404441s) [seg_pos={0 0}, upload=90253]: Segment reached optimal threshold of 13 pieces.
Jul 23 15:46:13.633942049 (112h55m20.006521404s) [noise=true , address=45.91.116.8:4048 , piece_id=PQLNQWIVBG77PGHYGTKVLSTXXS55TBM2UQBKCICBKXZ576RR3KUA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634030579 (112h55m20.006609934s) [noise=true , address=104.36.82.10:4077 , piece_id=VISWYOBUEVZQGPBDDXB7GIT5GRAV2IGCZC5DCBN4Z4DIRKSHUUPA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Jul 23 15:46:13.634108087 (112h55m20.006687442s) [noise=true , address=104.36.82.10:4078 , piece_id=ZTC56VXYSVF7N2LSYT35MXIYT7JXUY3W4UMLX77M4V5PO2EGPOIA, seg_pos={0 0}, upload=90253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48430->104.36.82.10:4078: use of closed network connection
Jul 23 15:46:13.634134918 (112h55m20.006714273s) [seg_pos={0 0}, upload=90253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 23 15:46:13.634191877 (112h55m20.006771242s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 23 15:46:13.634195865 (112h55m20.00677522s) [upload=90253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 23 15:46:13.931759396 (112h55m20.304338771s) [upload=90253]: Done uploading segments...
Jul 23 15:46:13.931781228 (112h55m20.304360583s) [upload=90253]: Upload finished. err: <nil>
Duration: 5.839037036s
core
uplink
us-select-1
|