Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.879116074s
FAIL (2025-07-19 04:24:27 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.879177162s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
7.646039595s
FAIL (2025-07-19 04:24:12 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.646065063s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.783542902s
FAIL (2025-07-19 04:23:17 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.783571387s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.687630634s
FAIL (2025-07-19 04:22:23 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.687654761s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
8.002906691s
FAIL (2025-07-19 04:21:51 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.002930628s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
7.431138438s
FAIL (2025-07-19 04:21:26 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.431164469s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
8.427496381s
FAIL (2025-07-19 04:20:18 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.427518775s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
11.429936784s
FAIL (2025-07-19 04:19:18 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 11.429964416s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
8.390492672s
FAIL (2025-07-19 04:18:01 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.390518592s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.436290144s
FAIL (2025-07-19 04:17:11 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.436321072s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.884124883s
FAIL (2025-07-19 04:16:45 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.884150313s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.854864966s
FAIL (2025-07-19 04:15:50 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.854891155s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
15.387373842s
FAIL (2025-07-19 04:15:08 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 15.387396394s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
7.491405346s
FAIL (2025-07-19 04:14:12 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.491435574s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
7.975670144s
FAIL (2025-07-19 04:13:52 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.975699s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
8.208180907s
FAIL (2025-07-19 04:13:07 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.208201557s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
13.262540754s
FAIL (2025-07-19 04:12:23 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 13.262563346s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
7.385875267s
FAIL (2025-07-19 04:12:00 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.385911817s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
15.28210615s
FAIL (2025-07-19 04:11:43 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 15.282181675s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.822848924s
FAIL (2025-07-19 04:10:32 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.822875614s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.753051494s
FAIL (2025-07-19 04:09:42 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.753076531s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
7.516443971s
FAIL (2025-07-19 04:08:39 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.516468578s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
7.480489849s
FAIL (2025-07-19 04:08:02 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.480506301s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
7.33713102s
FAIL (2025-07-19 04:07:12 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.337187569s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.952704236s
FAIL (2025-07-19 04:06:45 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.952727339s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
7.532391405s
FAIL (2025-07-19 04:06:26 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.532415151s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
8.443945744s
FAIL (2025-07-19 04:05:56 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.443970881s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
8.694622686s
FAIL (2025-07-19 04:05:35 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.694651231s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.837517371s
FAIL (2025-07-19 04:04:48 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.837550354s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
8.415224785s
FAIL (2025-07-19 04:04:00 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.415254742s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.837034175s
FAIL (2025-07-19 04:03:35 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.837056157s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
7.922955782s
FAIL (2025-07-19 04:03:00 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.922983134s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.8985127s
FAIL (2025-07-19 04:01:46 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.898547668s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
8.01514202s
FAIL (2025-07-19 04:01:20 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.015168281s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
8.735579602s
FAIL (2025-07-19 04:00:55 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.735606672s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
7.662535421s
FAIL (2025-07-19 04:00:29 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 7.66255637s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.774306978s
FAIL (2025-07-19 03:59:29 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.774322727s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
2m23.392087004s
FAIL (2025-07-19 03:59:23 UTC)
orbiter warning:
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
d network connection
Jul 19 03:55:50.588700290 (5h4m56.961279635s) [noise=true , address=77.90.31.18:4805 , piece_id=5UNY5TE5BUPQMBIF72FDWT4YVDWGEZZ6LYVBO7ANKDKBHJPXAKIA, seg_pos={0 0}, upload=4041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Jul 19 03:55:50.588752119 (5h4m56.961331474s) [seg_pos={0 0}, upload=4041]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:55:50.588840779 (5h4m56.961420134s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:55:50.588846049 (5h4m56.961425404s) [upload=4041]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:55:50.862788155 (5h4m57.23536751s) [upload=4041]: Done uploading segments...
Jul 19 03:55:50.862808112 (5h4m57.235387467s) [upload=4041]: Upload finished. err: <nil>
Jul 19 03:57:00.952603526 (5h6m7.325182881s) [upload=4057]: Starting upload
Jul 19 03:57:00.952662148 (5h6m7.325241523s) [upload=4057]: Done starting upload
Jul 19 03:57:00.952755756 (5h6m7.325335111s) [upload=4057]: Uploading segments...
Jul 19 03:57:00.952878392 (5h6m7.325457747s) [upload=4057]: Got next segment. Inline: false
Jul 19 03:57:00.952914330 (5h6m7.325493675s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 03:57:00.952919900 (5h6m7.325499255s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 03:57:01.188368206 (5h6m7.560947561s) [seg_pos={0 0}, upload=4057]: Begin upload segment...
Jul 19 03:57:01.188405837 (5h6m7.560985192s) [seg_pos={0 0}, upload=4057]: Done begin upload segment.
Jul 19 03:57:01.188433881 (5h6m7.561013236s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188471683 (5h6m7.561051098s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.188793689 (5h6m7.561373044s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189154039 (5h6m7.561733394s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189428814 (5h6m7.562008169s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189450466 (5h6m7.562029821s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189780508 (5h6m7.562359863s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.189821466 (5h6m7.562400821s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190223174 (5h6m7.562802529s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190313167 (5h6m7.562892512s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190468354 (5h6m7.563047709s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190520664 (5h6m7.563100019s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190731417 (5h6m7.563310782s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.190896333 (5h6m7.563475698s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191142764 (5h6m7.563722119s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:01.191246532 (5h6m7.563825887s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Uploading piece...
Jul 19 03:57:02.948067971 (5h6m9.320647326s) [upload=4057]: Next returned nil segment
Jul 19 03:57:02.948086357 (5h6m9.320665712s) [upload=4057]: Waiting for error group managing segments...
Jul 19 03:57:03.238444561 (5h6m9.611023916s) [noise=true , address=45.91.116.14:4189 , piece_id=35KEJB2BISQK6H3NS5JYTIU4RLH2ZJYL3IDIREW2UKZ55TUOW6GA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.250389355 (5h6m9.6229687s) [noise=true , address=45.91.116.4:4937 , piece_id=B64BEYMBTSPGDBGPHDVNGMZMFJZBMFF7DM4JSTS5SOS7GOATTPDA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.251034119 (5h6m9.623613474s) [noise=true , address=45.91.116.6:4973 , piece_id=6H5JF44FJG2TPRR7EBUBRGEKK4RDZY3LDEEM43X43R4MELZ5I53Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.263366183 (5h6m9.635945558s) [noise=true , address=45.91.116.10:4081 , piece_id=TTGDQEXMTXEF3FFBNGM3OORNLI7UJLP425HINTJ6OQIVRQG5ZQRA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.321950553 (5h6m9.694529908s) [noise=true , address=104.36.82.11:4115 , piece_id=UXSVWNLCG2TRR6GA5RIASW2HVEHJHVGEJOTJX57QQZ76GWR7D3FQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.332673900 (5h6m9.705253255s) [noise=true , address=104.36.82.3:4765 , piece_id=ISHXBHLWCHKBWVMOQXNO2SKNY6KTZIIN6OXMVSHJA6VEZ7SE4X6Q, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.341648953 (5h6m9.714228308s) [noise=true , address=45.91.116.13:4155 , piece_id=L7R7FOT3ES52GLCQQPIW2HWMJP23LD4333OFHIWI5UNTT47KCTSQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.343719043 (5h6m9.716298398s) [noise=true , address=45.91.116.8:4048 , piece_id=JT72V4S4RFG2FWUFTIP2D5K5QL5ZVNAYH42JV3TAR2O4STVYCLAQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.347782328 (5h6m9.720361683s) [noise=true , address=104.36.82.15:4258 , piece_id=LZS53AW4U6X4R6V7LCP6WV2VY4BEMUFEDAYFDO5EPCAVLASZCEPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.354893633 (5h6m9.727472998s) [noise=true , address=45.91.116.9:4263 , piece_id=AWSRDUCWXEXSDS5YBPROGCRJPYJH4G3T4JELM3JXF4ULWBUNXAZA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:03.380020720 (5h6m9.752600075s) [noise=true , address=104.36.82.12:4150 , piece_id=HRXGHVIFPHWKOPIPWZOIRFXS6XV6CFWG25WQKVLOUQVNTNJHV2HA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.220478869 (5h6m11.593058225s) [noise=true , address=77.90.31.11:4555 , piece_id=JVPDEWNIZDRUKT5PAPL3C6JCBYJC5INX7HUGGBI2PGI64P6AZ4AA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275708140 (5h6m11.648287495s) [noise=true , address=77.90.31.15:4699 , piece_id=ZROX6BVXQCZ6EB6AMB6OESSZD3QG2H6HIQDVKJGWCJMB6QR62TWQ, seg_pos={0 0}, upload=4057]: Done uploading piece. err: <nil>
Jul 19 03:57:05.275729681 (5h6m11.648309036s) [seg_pos={0 0}, upload=4057]: Segment reached optimal threshold of 13 pieces.
Jul 19 03:57:05.275878185 (5h6m11.64845753s) [noise=true , address=77.90.31.21:4877 , piece_id=VIGIC56R7QAURK3C34ATOF5H467ZWSBTKK6ZCK3IXZYQGHMJTD7A, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.275971504 (5h6m11.648550849s) [noise=true , address=77.90.31.19:4842 , piece_id=ZR6JTOMFIQOO3DKVMYAM54CS6TDHHCMN2Y2P6RLSP4BWK5MAHTPA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF
Jul 19 03:57:05.276081555 (5h6m11.64866091s) [noise=true , address=77.90.31.10:4519 , piece_id=YHGR7JZKLUC4KIQVGZPK4TECJ6KGADCEB3OCM42223C5LU6J5JVA, seg_pos={0 0}, upload=4057]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34236->77.90.31.10:4519: use of closed network connection
Jul 19 03:57:05.276132543 (5h6m11.648711898s) [seg_pos={0 0}, upload=4057]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 03:57:05.276207365 (5h6m11.64878672s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 03:57:05.276211424 (5h6m11.648790769s) [upload=4057]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 03:59:23.699026037 (5h8m30.071605382s) [upload=4057]: Done uploading segments...
Jul 19 03:59:23.699046667 (5h8m30.071626022s) [upload=4057]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2m23.392106773s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
182.691612ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:40:39 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 182.718815ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
176.552266ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:39:58 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 176.599066ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
219.466208ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:39:24 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 219.48266ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
184.359333ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:38:24 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 184.376687ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
173.60495ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:38:06 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 173.630419ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
188.462925ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:37:26 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 188.487882ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
173.580482ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:36:57 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 173.606199ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
173.224309ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:36:11 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 173.259126ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
171.841232ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:35:18 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 171.872081ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
181.909132ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:34:41 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 181.930575ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
177.369718ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:33:58 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 177.408732ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
175.924371ms remote:
"tcp:207.211.208.129:443" response headers:
Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=SnJ8g8bqTsN Date=Fri, 18 Jul 2025 22:59:10 GMT Content-Type=text/html; charset=utf-8 target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-18 23:32:59 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error | Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error | Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error | Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=3d9bd86\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY"
Duration: 175.946473ms
edge
linksharing
bgp
eu1
|