Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
6.287675579s trace:
https://jaeger.dev.storj.io/trace/49621e5e6beafe8e
FAIL (2025-11-11 08:12:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Nov 11 08:10:09.433180409 (48h6m7.98465087s) [upload=42408]: Starting upload
Nov 11 08:10:09.433429884 (48h6m7.984900335s) [upload=42408]: Done starting upload
Nov 11 08:10:09.433567967 (48h6m7.985038438s) [upload=42408]: Uploading segments...
Nov 11 08:10:09.434191213 (48h6m7.985661674s) [upload=42408]: Got next segment. Inline: false
Nov 11 08:10:09.434274032 (48h6m7.985744493s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 11 08:10:09.434282217 (48h6m7.985752688s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 11 08:10:09.714872160 (48h6m8.266342621s) [seg_pos={0 0}, upload=42408]: Begin upload segment...
Nov 11 08:10:09.715084585 (48h6m8.266555046s) [seg_pos={0 0}, upload=42408]: Done begin upload segment.
Nov 11 08:10:09.715464638 (48h6m8.2669351s) [noise=true , address=45.91.116.8:4047 , piece_id=VP6VW2ZTNSKS35R47GGJZI4YSHNNFUFB4YQ3W3QFT5ENN7F73VQA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.715555221 (48h6m8.267025692s) [noise=true , address=145.79.227.30:4761 , piece_id=ASO5O5LM6CEF6DXGBVOCI3NOCWLGKDU2T5JHOL5ZPWEXMTRMKZIA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.718085410 (48h6m8.269555901s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.718721901 (48h6m8.270192402s) [noise=true , address=145.79.227.11:4729 , piece_id=CDIU7FFPCVQGDK3K5ZDUARJ6VGB7KIY2DEVL7ZRLW5EASIFEHKHA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.719505724 (48h6m8.270976195s) [noise=true , address=145.79.227.27:4689 , piece_id=KLTJYVDWHEE2BGLUSP2XT6L5R2C5OB7TF4DZLYBF6R5OG3N6AEFQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.720136295 (48h6m8.271606756s) [noise=true , address=145.79.227.14:4840 , piece_id=QASWXZB3E6E7VYGF24KZ37Q3LKT6F4WVFKTBV3YS73KYAWTBV7YQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.721166056 (48h6m8.272636517s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.721883453 (48h6m8.273353994s) [noise=true , address=45.91.116.4:4939 , piece_id=KMHEQSQTA2WEWMIO7JDQZUDLSRV4CA6OJUN2CYYUSA7SU2ZDQBCQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.722398593 (48h6m8.273869054s) [noise=true , address=77.90.31.18:4806 , piece_id=LNL5LRHH3OOELKEO4HND2K3GNVDPCBCGKBNJ75DCLEKRAOMTQLKA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.724101306 (48h6m8.275571767s) [noise=true , address=145.79.227.17:4970 , piece_id=F2227LWTX5PRCQIUEJNRJ3QS3GRJOIEJIZFV3KRF7BAEAPSQZR7A, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.726385264 (48h6m8.277855776s) [noise=true , address=45.91.116.11:4117 , piece_id=UOEFPOPOFIO5KXY2JOX54YHUWNMTCAFMXEBKAMMR4GSR5ZE6J6PA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.728323225 (48h6m8.279793686s) [noise=true , address=145.79.227.20:4437 , piece_id=AOK6MTRZKPCXTNHZWGBYJGRBYNHFWO7GSG2PT4DFSMDAWK75GY4A, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.730321541 (48h6m8.281792002s) [noise=true , address=145.79.227.9:4366 , piece_id=JDBR4PTBZ5RN6NTWPERVLFANUAZQF3FSGIENVRHSYN56ED5NT2AQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.731324300 (48h6m8.282794832s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.732226989 (48h6m8.28369749s) [noise=true , address=77.90.31.19:4841 , piece_id=6JVB2WIEA2STMNBVTM6D7IYFHQY4QJGXAYHJAQILMYZZDH2MWIVA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.733026101 (48h6m8.284496562s) [noise=true , address=145.79.227.21:4474 , piece_id=RNB5T6DIUCY7IV2ULLO2UJRDKUJXI34UM4ZCHPJB22DNQ47VZJVA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:11.398415378 (48h6m9.949885839s) [upload=42408]: Next returned nil segment
Nov 11 08:10:11.398434043 (48h6m9.949904504s) [upload=42408]: Waiting for error group managing segments...
Nov 11 08:10:11.796154582 (48h6m10.347625043s) [noise=true , address=77.90.31.18:4806 , piece_id=LNL5LRHH3OOELKEO4HND2K3GNVDPCBCGKBNJ75DCLEKRAOMTQLKA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.809043214 (48h6m10.360513675s) [noise=true , address=45.91.116.8:4047 , piece_id=VP6VW2ZTNSKS35R47GGJZI4YSHNNFUFB4YQ3W3QFT5ENN7F73VQA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.866335992 (48h6m10.417806453s) [noise=true , address=45.91.116.11:4117 , piece_id=UOEFPOPOFIO5KXY2JOX54YHUWNMTCAFMXEBKAMMR4GSR5ZE6J6PA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.932922087 (48h6m10.484392538s) [noise=true , address=77.90.31.19:4841 , piece_id=6JVB2WIEA2STMNBVTM6D7IYFHQY4QJGXAYHJAQILMYZZDH2MWIVA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:12.005905333 (48h6m10.557375794s) [noise=true , address=45.91.116.4:4939 , piece_id=KMHEQSQTA2WEWMIO7JDQZUDLSRV4CA6OJUN2CYYUSA7SU2ZDQBCQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:16.703757864 (48h6m15.255228326s) [noise=true , address=145.79.227.9:4366 , piece_id=JDBR4PTBZ5RN6NTWPERVLFANUAZQF3FSGIENVRHSYN56ED5NT2AQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:17.540298352 (48h6m16.091768813s) [noise=true , address=145.79.227.21:4474 , piece_id=RNB5T6DIUCY7IV2ULLO2UJRDKUJXI34UM4ZCHPJB22DNQ47VZJVA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:19.805526866 (48h6m18.356997337s) [noise=true , address=145.79.227.27:4689 , piece_id=KLTJYVDWHEE2BGLUSP2XT6L5R2C5OB7TF4DZLYBF6R5OG3N6AEFQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:24.397542313 (48h6m22.949012764s) [noise=true , address=145.79.227.17:4970 , piece_id=F2227LWTX5PRCQIUEJNRJ3QS3GRJOIEJIZFV3KRF7BAEAPSQZR7A, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:24.779686050 (48h6m23.331156511s) [noise=true , address=145.79.227.14:4840 , piece_id=QASWXZB3E6E7VYGF24KZ37Q3LKT6F4WVFKTBV3YS73KYAWTBV7YQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:25.298168925 (48h6m23.849639387s) [noise=true , address=145.79.227.11:4729 , piece_id=CDIU7FFPCVQGDK3K5ZDUARJ6VGB7KIY2DEVL7ZRLW5EASIFEHKHA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:35.044925402 (48h6m33.596395853s) [noise=true , address=145.79.227.30:4761 , piece_id=ASO5O5LM6CEF6DXGBVOCI3NOCWLGKDU2T5JHOL5ZPWEXMTRMKZIA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:37.306959937 (48h6m35.858430398s) [noise=true , address=145.79.227.20:4437 , piece_id=AOK6MTRZKPCXTNHZWGBYJGRBYNHFWO7GSG2PT4DFSMDAWK75GY4A, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:37.306987550 (48h6m35.858458011s) [seg_pos={0 0}, upload=42408]: Segment reached optimal threshold of 13 pieces.
Nov 11 08:10:37.307209231 (48h6m35.858679702s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF
Nov 11 08:10:37.307218759 (48h6m35.85868922s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307368936 (48h6m35.858839397s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: expected piece hash; context canceled; EOF
Nov 11 08:10:37.307376741 (48h6m35.858847202s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307561282 (48h6m35.859031743s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection; write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection
Nov 11 08:10:37.307585969 (48h6m35.85905643s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307629221 (48h6m35.859099682s) [seg_pos={0 0}, upload=42408]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 11 08:10:37.307741005 (48h6m35.859211466s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 11 08:10:37.307750052 (48h6m35.859220513s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 11 08:10:37.612339386 (48h6m36.163809848s) [upload=42408]: Done uploading segments...
Nov 11 08:10:37.612366317 (48h6m36.163836788s) [upload=42408]: Upload finished. err: <nil>
Duration: 6.287704615s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.96449456s trace:
https://jaeger.dev.storj.io/trace/49621e5e6beafe8e
FAIL (2025-11-11 08:12:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Nov 11 08:10:09.433180409 (48h6m7.98465087s) [upload=42408]: Starting upload
Nov 11 08:10:09.433429884 (48h6m7.984900335s) [upload=42408]: Done starting upload
Nov 11 08:10:09.433567967 (48h6m7.985038438s) [upload=42408]: Uploading segments...
Nov 11 08:10:09.434191213 (48h6m7.985661674s) [upload=42408]: Got next segment. Inline: false
Nov 11 08:10:09.434274032 (48h6m7.985744493s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 11 08:10:09.434282217 (48h6m7.985752688s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 11 08:10:09.714872160 (48h6m8.266342621s) [seg_pos={0 0}, upload=42408]: Begin upload segment...
Nov 11 08:10:09.715084585 (48h6m8.266555046s) [seg_pos={0 0}, upload=42408]: Done begin upload segment.
Nov 11 08:10:09.715464638 (48h6m8.2669351s) [noise=true , address=45.91.116.8:4047 , piece_id=VP6VW2ZTNSKS35R47GGJZI4YSHNNFUFB4YQ3W3QFT5ENN7F73VQA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.715555221 (48h6m8.267025692s) [noise=true , address=145.79.227.30:4761 , piece_id=ASO5O5LM6CEF6DXGBVOCI3NOCWLGKDU2T5JHOL5ZPWEXMTRMKZIA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.718085410 (48h6m8.269555901s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.718721901 (48h6m8.270192402s) [noise=true , address=145.79.227.11:4729 , piece_id=CDIU7FFPCVQGDK3K5ZDUARJ6VGB7KIY2DEVL7ZRLW5EASIFEHKHA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.719505724 (48h6m8.270976195s) [noise=true , address=145.79.227.27:4689 , piece_id=KLTJYVDWHEE2BGLUSP2XT6L5R2C5OB7TF4DZLYBF6R5OG3N6AEFQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.720136295 (48h6m8.271606756s) [noise=true , address=145.79.227.14:4840 , piece_id=QASWXZB3E6E7VYGF24KZ37Q3LKT6F4WVFKTBV3YS73KYAWTBV7YQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.721166056 (48h6m8.272636517s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.721883453 (48h6m8.273353994s) [noise=true , address=45.91.116.4:4939 , piece_id=KMHEQSQTA2WEWMIO7JDQZUDLSRV4CA6OJUN2CYYUSA7SU2ZDQBCQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.722398593 (48h6m8.273869054s) [noise=true , address=77.90.31.18:4806 , piece_id=LNL5LRHH3OOELKEO4HND2K3GNVDPCBCGKBNJ75DCLEKRAOMTQLKA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.724101306 (48h6m8.275571767s) [noise=true , address=145.79.227.17:4970 , piece_id=F2227LWTX5PRCQIUEJNRJ3QS3GRJOIEJIZFV3KRF7BAEAPSQZR7A, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.726385264 (48h6m8.277855776s) [noise=true , address=45.91.116.11:4117 , piece_id=UOEFPOPOFIO5KXY2JOX54YHUWNMTCAFMXEBKAMMR4GSR5ZE6J6PA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.728323225 (48h6m8.279793686s) [noise=true , address=145.79.227.20:4437 , piece_id=AOK6MTRZKPCXTNHZWGBYJGRBYNHFWO7GSG2PT4DFSMDAWK75GY4A, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.730321541 (48h6m8.281792002s) [noise=true , address=145.79.227.9:4366 , piece_id=JDBR4PTBZ5RN6NTWPERVLFANUAZQF3FSGIENVRHSYN56ED5NT2AQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.731324300 (48h6m8.282794832s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.732226989 (48h6m8.28369749s) [noise=true , address=77.90.31.19:4841 , piece_id=6JVB2WIEA2STMNBVTM6D7IYFHQY4QJGXAYHJAQILMYZZDH2MWIVA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.733026101 (48h6m8.284496562s) [noise=true , address=145.79.227.21:4474 , piece_id=RNB5T6DIUCY7IV2ULLO2UJRDKUJXI34UM4ZCHPJB22DNQ47VZJVA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:11.398415378 (48h6m9.949885839s) [upload=42408]: Next returned nil segment
Nov 11 08:10:11.398434043 (48h6m9.949904504s) [upload=42408]: Waiting for error group managing segments...
Nov 11 08:10:11.796154582 (48h6m10.347625043s) [noise=true , address=77.90.31.18:4806 , piece_id=LNL5LRHH3OOELKEO4HND2K3GNVDPCBCGKBNJ75DCLEKRAOMTQLKA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.809043214 (48h6m10.360513675s) [noise=true , address=45.91.116.8:4047 , piece_id=VP6VW2ZTNSKS35R47GGJZI4YSHNNFUFB4YQ3W3QFT5ENN7F73VQA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.866335992 (48h6m10.417806453s) [noise=true , address=45.91.116.11:4117 , piece_id=UOEFPOPOFIO5KXY2JOX54YHUWNMTCAFMXEBKAMMR4GSR5ZE6J6PA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.932922087 (48h6m10.484392538s) [noise=true , address=77.90.31.19:4841 , piece_id=6JVB2WIEA2STMNBVTM6D7IYFHQY4QJGXAYHJAQILMYZZDH2MWIVA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:12.005905333 (48h6m10.557375794s) [noise=true , address=45.91.116.4:4939 , piece_id=KMHEQSQTA2WEWMIO7JDQZUDLSRV4CA6OJUN2CYYUSA7SU2ZDQBCQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:16.703757864 (48h6m15.255228326s) [noise=true , address=145.79.227.9:4366 , piece_id=JDBR4PTBZ5RN6NTWPERVLFANUAZQF3FSGIENVRHSYN56ED5NT2AQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:17.540298352 (48h6m16.091768813s) [noise=true , address=145.79.227.21:4474 , piece_id=RNB5T6DIUCY7IV2ULLO2UJRDKUJXI34UM4ZCHPJB22DNQ47VZJVA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:19.805526866 (48h6m18.356997337s) [noise=true , address=145.79.227.27:4689 , piece_id=KLTJYVDWHEE2BGLUSP2XT6L5R2C5OB7TF4DZLYBF6R5OG3N6AEFQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:24.397542313 (48h6m22.949012764s) [noise=true , address=145.79.227.17:4970 , piece_id=F2227LWTX5PRCQIUEJNRJ3QS3GRJOIEJIZFV3KRF7BAEAPSQZR7A, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:24.779686050 (48h6m23.331156511s) [noise=true , address=145.79.227.14:4840 , piece_id=QASWXZB3E6E7VYGF24KZ37Q3LKT6F4WVFKTBV3YS73KYAWTBV7YQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:25.298168925 (48h6m23.849639387s) [noise=true , address=145.79.227.11:4729 , piece_id=CDIU7FFPCVQGDK3K5ZDUARJ6VGB7KIY2DEVL7ZRLW5EASIFEHKHA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:35.044925402 (48h6m33.596395853s) [noise=true , address=145.79.227.30:4761 , piece_id=ASO5O5LM6CEF6DXGBVOCI3NOCWLGKDU2T5JHOL5ZPWEXMTRMKZIA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:37.306959937 (48h6m35.858430398s) [noise=true , address=145.79.227.20:4437 , piece_id=AOK6MTRZKPCXTNHZWGBYJGRBYNHFWO7GSG2PT4DFSMDAWK75GY4A, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:37.306987550 (48h6m35.858458011s) [seg_pos={0 0}, upload=42408]: Segment reached optimal threshold of 13 pieces.
Nov 11 08:10:37.307209231 (48h6m35.858679702s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF
Nov 11 08:10:37.307218759 (48h6m35.85868922s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307368936 (48h6m35.858839397s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: expected piece hash; context canceled; EOF
Nov 11 08:10:37.307376741 (48h6m35.858847202s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307561282 (48h6m35.859031743s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection; write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection
Nov 11 08:10:37.307585969 (48h6m35.85905643s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307629221 (48h6m35.859099682s) [seg_pos={0 0}, upload=42408]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 11 08:10:37.307741005 (48h6m35.859211466s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 11 08:10:37.307750052 (48h6m35.859220513s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 11 08:10:37.612339386 (48h6m36.163809848s) [upload=42408]: Done uploading segments...
Nov 11 08:10:37.612366317 (48h6m36.163836788s) [upload=42408]: Upload finished. err: <nil>
Duration: 5.964514629s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.974728187s trace:
https://jaeger.dev.storj.io/trace/49621e5e6beafe8e
FAIL (2025-11-11 08:12:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Nov 11 08:10:09.433180409 (48h6m7.98465087s) [upload=42408]: Starting upload
Nov 11 08:10:09.433429884 (48h6m7.984900335s) [upload=42408]: Done starting upload
Nov 11 08:10:09.433567967 (48h6m7.985038438s) [upload=42408]: Uploading segments...
Nov 11 08:10:09.434191213 (48h6m7.985661674s) [upload=42408]: Got next segment. Inline: false
Nov 11 08:10:09.434274032 (48h6m7.985744493s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 11 08:10:09.434282217 (48h6m7.985752688s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 11 08:10:09.714872160 (48h6m8.266342621s) [seg_pos={0 0}, upload=42408]: Begin upload segment...
Nov 11 08:10:09.715084585 (48h6m8.266555046s) [seg_pos={0 0}, upload=42408]: Done begin upload segment.
Nov 11 08:10:09.715464638 (48h6m8.2669351s) [noise=true , address=45.91.116.8:4047 , piece_id=VP6VW2ZTNSKS35R47GGJZI4YSHNNFUFB4YQ3W3QFT5ENN7F73VQA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.715555221 (48h6m8.267025692s) [noise=true , address=145.79.227.30:4761 , piece_id=ASO5O5LM6CEF6DXGBVOCI3NOCWLGKDU2T5JHOL5ZPWEXMTRMKZIA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.718085410 (48h6m8.269555901s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.718721901 (48h6m8.270192402s) [noise=true , address=145.79.227.11:4729 , piece_id=CDIU7FFPCVQGDK3K5ZDUARJ6VGB7KIY2DEVL7ZRLW5EASIFEHKHA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.719505724 (48h6m8.270976195s) [noise=true , address=145.79.227.27:4689 , piece_id=KLTJYVDWHEE2BGLUSP2XT6L5R2C5OB7TF4DZLYBF6R5OG3N6AEFQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.720136295 (48h6m8.271606756s) [noise=true , address=145.79.227.14:4840 , piece_id=QASWXZB3E6E7VYGF24KZ37Q3LKT6F4WVFKTBV3YS73KYAWTBV7YQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.721166056 (48h6m8.272636517s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.721883453 (48h6m8.273353994s) [noise=true , address=45.91.116.4:4939 , piece_id=KMHEQSQTA2WEWMIO7JDQZUDLSRV4CA6OJUN2CYYUSA7SU2ZDQBCQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.722398593 (48h6m8.273869054s) [noise=true , address=77.90.31.18:4806 , piece_id=LNL5LRHH3OOELKEO4HND2K3GNVDPCBCGKBNJ75DCLEKRAOMTQLKA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.724101306 (48h6m8.275571767s) [noise=true , address=145.79.227.17:4970 , piece_id=F2227LWTX5PRCQIUEJNRJ3QS3GRJOIEJIZFV3KRF7BAEAPSQZR7A, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.726385264 (48h6m8.277855776s) [noise=true , address=45.91.116.11:4117 , piece_id=UOEFPOPOFIO5KXY2JOX54YHUWNMTCAFMXEBKAMMR4GSR5ZE6J6PA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.728323225 (48h6m8.279793686s) [noise=true , address=145.79.227.20:4437 , piece_id=AOK6MTRZKPCXTNHZWGBYJGRBYNHFWO7GSG2PT4DFSMDAWK75GY4A, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.730321541 (48h6m8.281792002s) [noise=true , address=145.79.227.9:4366 , piece_id=JDBR4PTBZ5RN6NTWPERVLFANUAZQF3FSGIENVRHSYN56ED5NT2AQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.731324300 (48h6m8.282794832s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.732226989 (48h6m8.28369749s) [noise=true , address=77.90.31.19:4841 , piece_id=6JVB2WIEA2STMNBVTM6D7IYFHQY4QJGXAYHJAQILMYZZDH2MWIVA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.733026101 (48h6m8.284496562s) [noise=true , address=145.79.227.21:4474 , piece_id=RNB5T6DIUCY7IV2ULLO2UJRDKUJXI34UM4ZCHPJB22DNQ47VZJVA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:11.398415378 (48h6m9.949885839s) [upload=42408]: Next returned nil segment
Nov 11 08:10:11.398434043 (48h6m9.949904504s) [upload=42408]: Waiting for error group managing segments...
Nov 11 08:10:11.796154582 (48h6m10.347625043s) [noise=true , address=77.90.31.18:4806 , piece_id=LNL5LRHH3OOELKEO4HND2K3GNVDPCBCGKBNJ75DCLEKRAOMTQLKA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.809043214 (48h6m10.360513675s) [noise=true , address=45.91.116.8:4047 , piece_id=VP6VW2ZTNSKS35R47GGJZI4YSHNNFUFB4YQ3W3QFT5ENN7F73VQA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.866335992 (48h6m10.417806453s) [noise=true , address=45.91.116.11:4117 , piece_id=UOEFPOPOFIO5KXY2JOX54YHUWNMTCAFMXEBKAMMR4GSR5ZE6J6PA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.932922087 (48h6m10.484392538s) [noise=true , address=77.90.31.19:4841 , piece_id=6JVB2WIEA2STMNBVTM6D7IYFHQY4QJGXAYHJAQILMYZZDH2MWIVA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:12.005905333 (48h6m10.557375794s) [noise=true , address=45.91.116.4:4939 , piece_id=KMHEQSQTA2WEWMIO7JDQZUDLSRV4CA6OJUN2CYYUSA7SU2ZDQBCQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:16.703757864 (48h6m15.255228326s) [noise=true , address=145.79.227.9:4366 , piece_id=JDBR4PTBZ5RN6NTWPERVLFANUAZQF3FSGIENVRHSYN56ED5NT2AQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:17.540298352 (48h6m16.091768813s) [noise=true , address=145.79.227.21:4474 , piece_id=RNB5T6DIUCY7IV2ULLO2UJRDKUJXI34UM4ZCHPJB22DNQ47VZJVA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:19.805526866 (48h6m18.356997337s) [noise=true , address=145.79.227.27:4689 , piece_id=KLTJYVDWHEE2BGLUSP2XT6L5R2C5OB7TF4DZLYBF6R5OG3N6AEFQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:24.397542313 (48h6m22.949012764s) [noise=true , address=145.79.227.17:4970 , piece_id=F2227LWTX5PRCQIUEJNRJ3QS3GRJOIEJIZFV3KRF7BAEAPSQZR7A, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:24.779686050 (48h6m23.331156511s) [noise=true , address=145.79.227.14:4840 , piece_id=QASWXZB3E6E7VYGF24KZ37Q3LKT6F4WVFKTBV3YS73KYAWTBV7YQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:25.298168925 (48h6m23.849639387s) [noise=true , address=145.79.227.11:4729 , piece_id=CDIU7FFPCVQGDK3K5ZDUARJ6VGB7KIY2DEVL7ZRLW5EASIFEHKHA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:35.044925402 (48h6m33.596395853s) [noise=true , address=145.79.227.30:4761 , piece_id=ASO5O5LM6CEF6DXGBVOCI3NOCWLGKDU2T5JHOL5ZPWEXMTRMKZIA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:37.306959937 (48h6m35.858430398s) [noise=true , address=145.79.227.20:4437 , piece_id=AOK6MTRZKPCXTNHZWGBYJGRBYNHFWO7GSG2PT4DFSMDAWK75GY4A, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:37.306987550 (48h6m35.858458011s) [seg_pos={0 0}, upload=42408]: Segment reached optimal threshold of 13 pieces.
Nov 11 08:10:37.307209231 (48h6m35.858679702s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF
Nov 11 08:10:37.307218759 (48h6m35.85868922s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307368936 (48h6m35.858839397s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: expected piece hash; context canceled; EOF
Nov 11 08:10:37.307376741 (48h6m35.858847202s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307561282 (48h6m35.859031743s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection; write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection
Nov 11 08:10:37.307585969 (48h6m35.85905643s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307629221 (48h6m35.859099682s) [seg_pos={0 0}, upload=42408]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 11 08:10:37.307741005 (48h6m35.859211466s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 11 08:10:37.307750052 (48h6m35.859220513s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 11 08:10:37.612339386 (48h6m36.163809848s) [upload=42408]: Done uploading segments...
Nov 11 08:10:37.612366317 (48h6m36.163836788s) [upload=42408]: Upload finished. err: <nil>
Duration: 5.974761421s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
29.816695451s trace:
https://jaeger.dev.storj.io/trace/49621e5e6beafe8e
FAIL (2025-11-11 08:11:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Nov 11 08:10:09.433180409 (48h6m7.98465087s) [upload=42408]: Starting upload
Nov 11 08:10:09.433429884 (48h6m7.984900335s) [upload=42408]: Done starting upload
Nov 11 08:10:09.433567967 (48h6m7.985038438s) [upload=42408]: Uploading segments...
Nov 11 08:10:09.434191213 (48h6m7.985661674s) [upload=42408]: Got next segment. Inline: false
Nov 11 08:10:09.434274032 (48h6m7.985744493s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 11 08:10:09.434282217 (48h6m7.985752688s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 11 08:10:09.714872160 (48h6m8.266342621s) [seg_pos={0 0}, upload=42408]: Begin upload segment...
Nov 11 08:10:09.715084585 (48h6m8.266555046s) [seg_pos={0 0}, upload=42408]: Done begin upload segment.
Nov 11 08:10:09.715464638 (48h6m8.2669351s) [noise=true , address=45.91.116.8:4047 , piece_id=VP6VW2ZTNSKS35R47GGJZI4YSHNNFUFB4YQ3W3QFT5ENN7F73VQA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.715555221 (48h6m8.267025692s) [noise=true , address=145.79.227.30:4761 , piece_id=ASO5O5LM6CEF6DXGBVOCI3NOCWLGKDU2T5JHOL5ZPWEXMTRMKZIA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.718085410 (48h6m8.269555901s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.718721901 (48h6m8.270192402s) [noise=true , address=145.79.227.11:4729 , piece_id=CDIU7FFPCVQGDK3K5ZDUARJ6VGB7KIY2DEVL7ZRLW5EASIFEHKHA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.719505724 (48h6m8.270976195s) [noise=true , address=145.79.227.27:4689 , piece_id=KLTJYVDWHEE2BGLUSP2XT6L5R2C5OB7TF4DZLYBF6R5OG3N6AEFQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.720136295 (48h6m8.271606756s) [noise=true , address=145.79.227.14:4840 , piece_id=QASWXZB3E6E7VYGF24KZ37Q3LKT6F4WVFKTBV3YS73KYAWTBV7YQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.721166056 (48h6m8.272636517s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.721883453 (48h6m8.273353994s) [noise=true , address=45.91.116.4:4939 , piece_id=KMHEQSQTA2WEWMIO7JDQZUDLSRV4CA6OJUN2CYYUSA7SU2ZDQBCQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.722398593 (48h6m8.273869054s) [noise=true , address=77.90.31.18:4806 , piece_id=LNL5LRHH3OOELKEO4HND2K3GNVDPCBCGKBNJ75DCLEKRAOMTQLKA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.724101306 (48h6m8.275571767s) [noise=true , address=145.79.227.17:4970 , piece_id=F2227LWTX5PRCQIUEJNRJ3QS3GRJOIEJIZFV3KRF7BAEAPSQZR7A, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.726385264 (48h6m8.277855776s) [noise=true , address=45.91.116.11:4117 , piece_id=UOEFPOPOFIO5KXY2JOX54YHUWNMTCAFMXEBKAMMR4GSR5ZE6J6PA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.728323225 (48h6m8.279793686s) [noise=true , address=145.79.227.20:4437 , piece_id=AOK6MTRZKPCXTNHZWGBYJGRBYNHFWO7GSG2PT4DFSMDAWK75GY4A, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.730321541 (48h6m8.281792002s) [noise=true , address=145.79.227.9:4366 , piece_id=JDBR4PTBZ5RN6NTWPERVLFANUAZQF3FSGIENVRHSYN56ED5NT2AQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.731324300 (48h6m8.282794832s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.732226989 (48h6m8.28369749s) [noise=true , address=77.90.31.19:4841 , piece_id=6JVB2WIEA2STMNBVTM6D7IYFHQY4QJGXAYHJAQILMYZZDH2MWIVA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.733026101 (48h6m8.284496562s) [noise=true , address=145.79.227.21:4474 , piece_id=RNB5T6DIUCY7IV2ULLO2UJRDKUJXI34UM4ZCHPJB22DNQ47VZJVA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:11.398415378 (48h6m9.949885839s) [upload=42408]: Next returned nil segment
Nov 11 08:10:11.398434043 (48h6m9.949904504s) [upload=42408]: Waiting for error group managing segments...
Nov 11 08:10:11.796154582 (48h6m10.347625043s) [noise=true , address=77.90.31.18:4806 , piece_id=LNL5LRHH3OOELKEO4HND2K3GNVDPCBCGKBNJ75DCLEKRAOMTQLKA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.809043214 (48h6m10.360513675s) [noise=true , address=45.91.116.8:4047 , piece_id=VP6VW2ZTNSKS35R47GGJZI4YSHNNFUFB4YQ3W3QFT5ENN7F73VQA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.866335992 (48h6m10.417806453s) [noise=true , address=45.91.116.11:4117 , piece_id=UOEFPOPOFIO5KXY2JOX54YHUWNMTCAFMXEBKAMMR4GSR5ZE6J6PA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.932922087 (48h6m10.484392538s) [noise=true , address=77.90.31.19:4841 , piece_id=6JVB2WIEA2STMNBVTM6D7IYFHQY4QJGXAYHJAQILMYZZDH2MWIVA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:12.005905333 (48h6m10.557375794s) [noise=true , address=45.91.116.4:4939 , piece_id=KMHEQSQTA2WEWMIO7JDQZUDLSRV4CA6OJUN2CYYUSA7SU2ZDQBCQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:16.703757864 (48h6m15.255228326s) [noise=true , address=145.79.227.9:4366 , piece_id=JDBR4PTBZ5RN6NTWPERVLFANUAZQF3FSGIENVRHSYN56ED5NT2AQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:17.540298352 (48h6m16.091768813s) [noise=true , address=145.79.227.21:4474 , piece_id=RNB5T6DIUCY7IV2ULLO2UJRDKUJXI34UM4ZCHPJB22DNQ47VZJVA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:19.805526866 (48h6m18.356997337s) [noise=true , address=145.79.227.27:4689 , piece_id=KLTJYVDWHEE2BGLUSP2XT6L5R2C5OB7TF4DZLYBF6R5OG3N6AEFQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:24.397542313 (48h6m22.949012764s) [noise=true , address=145.79.227.17:4970 , piece_id=F2227LWTX5PRCQIUEJNRJ3QS3GRJOIEJIZFV3KRF7BAEAPSQZR7A, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:24.779686050 (48h6m23.331156511s) [noise=true , address=145.79.227.14:4840 , piece_id=QASWXZB3E6E7VYGF24KZ37Q3LKT6F4WVFKTBV3YS73KYAWTBV7YQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:25.298168925 (48h6m23.849639387s) [noise=true , address=145.79.227.11:4729 , piece_id=CDIU7FFPCVQGDK3K5ZDUARJ6VGB7KIY2DEVL7ZRLW5EASIFEHKHA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:35.044925402 (48h6m33.596395853s) [noise=true , address=145.79.227.30:4761 , piece_id=ASO5O5LM6CEF6DXGBVOCI3NOCWLGKDU2T5JHOL5ZPWEXMTRMKZIA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:37.306959937 (48h6m35.858430398s) [noise=true , address=145.79.227.20:4437 , piece_id=AOK6MTRZKPCXTNHZWGBYJGRBYNHFWO7GSG2PT4DFSMDAWK75GY4A, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:37.306987550 (48h6m35.858458011s) [seg_pos={0 0}, upload=42408]: Segment reached optimal threshold of 13 pieces.
Nov 11 08:10:37.307209231 (48h6m35.858679702s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF
Nov 11 08:10:37.307218759 (48h6m35.85868922s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307368936 (48h6m35.858839397s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: expected piece hash; context canceled; EOF
Nov 11 08:10:37.307376741 (48h6m35.858847202s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307561282 (48h6m35.859031743s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection; write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection
Nov 11 08:10:37.307585969 (48h6m35.85905643s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307629221 (48h6m35.859099682s) [seg_pos={0 0}, upload=42408]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 11 08:10:37.307741005 (48h6m35.859211466s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 11 08:10:37.307750052 (48h6m35.859220513s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 11 08:10:37.612339386 (48h6m36.163809848s) [upload=42408]: Done uploading segments...
Nov 11 08:10:37.612366317 (48h6m36.163836788s) [upload=42408]: Upload finished. err: <nil>
Duration: 29.816733434s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002467364s trace:
https://jaeger.dev.storj.io/trace/49621e5e6beafe8e
FAIL (2025-11-11 08:10:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Nov 11 08:10:09.433180409 (48h6m7.98465087s) [upload=42408]: Starting upload
Nov 11 08:10:09.433429884 (48h6m7.984900335s) [upload=42408]: Done starting upload
Nov 11 08:10:09.433567967 (48h6m7.985038438s) [upload=42408]: Uploading segments...
Nov 11 08:10:09.434191213 (48h6m7.985661674s) [upload=42408]: Got next segment. Inline: false
Nov 11 08:10:09.434274032 (48h6m7.985744493s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 11 08:10:09.434282217 (48h6m7.985752688s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 11 08:10:09.714872160 (48h6m8.266342621s) [seg_pos={0 0}, upload=42408]: Begin upload segment...
Nov 11 08:10:09.715084585 (48h6m8.266555046s) [seg_pos={0 0}, upload=42408]: Done begin upload segment.
Nov 11 08:10:09.715464638 (48h6m8.2669351s) [noise=true , address=45.91.116.8:4047 , piece_id=VP6VW2ZTNSKS35R47GGJZI4YSHNNFUFB4YQ3W3QFT5ENN7F73VQA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.715555221 (48h6m8.267025692s) [noise=true , address=145.79.227.30:4761 , piece_id=ASO5O5LM6CEF6DXGBVOCI3NOCWLGKDU2T5JHOL5ZPWEXMTRMKZIA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.718085410 (48h6m8.269555901s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.718721901 (48h6m8.270192402s) [noise=true , address=145.79.227.11:4729 , piece_id=CDIU7FFPCVQGDK3K5ZDUARJ6VGB7KIY2DEVL7ZRLW5EASIFEHKHA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.719505724 (48h6m8.270976195s) [noise=true , address=145.79.227.27:4689 , piece_id=KLTJYVDWHEE2BGLUSP2XT6L5R2C5OB7TF4DZLYBF6R5OG3N6AEFQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.720136295 (48h6m8.271606756s) [noise=true , address=145.79.227.14:4840 , piece_id=QASWXZB3E6E7VYGF24KZ37Q3LKT6F4WVFKTBV3YS73KYAWTBV7YQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.721166056 (48h6m8.272636517s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.721883453 (48h6m8.273353994s) [noise=true , address=45.91.116.4:4939 , piece_id=KMHEQSQTA2WEWMIO7JDQZUDLSRV4CA6OJUN2CYYUSA7SU2ZDQBCQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.722398593 (48h6m8.273869054s) [noise=true , address=77.90.31.18:4806 , piece_id=LNL5LRHH3OOELKEO4HND2K3GNVDPCBCGKBNJ75DCLEKRAOMTQLKA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.724101306 (48h6m8.275571767s) [noise=true , address=145.79.227.17:4970 , piece_id=F2227LWTX5PRCQIUEJNRJ3QS3GRJOIEJIZFV3KRF7BAEAPSQZR7A, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.726385264 (48h6m8.277855776s) [noise=true , address=45.91.116.11:4117 , piece_id=UOEFPOPOFIO5KXY2JOX54YHUWNMTCAFMXEBKAMMR4GSR5ZE6J6PA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.728323225 (48h6m8.279793686s) [noise=true , address=145.79.227.20:4437 , piece_id=AOK6MTRZKPCXTNHZWGBYJGRBYNHFWO7GSG2PT4DFSMDAWK75GY4A, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.730321541 (48h6m8.281792002s) [noise=true , address=145.79.227.9:4366 , piece_id=JDBR4PTBZ5RN6NTWPERVLFANUAZQF3FSGIENVRHSYN56ED5NT2AQ, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.731324300 (48h6m8.282794832s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.732226989 (48h6m8.28369749s) [noise=true , address=77.90.31.19:4841 , piece_id=6JVB2WIEA2STMNBVTM6D7IYFHQY4QJGXAYHJAQILMYZZDH2MWIVA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:09.733026101 (48h6m8.284496562s) [noise=true , address=145.79.227.21:4474 , piece_id=RNB5T6DIUCY7IV2ULLO2UJRDKUJXI34UM4ZCHPJB22DNQ47VZJVA, seg_pos={0 0}, upload=42408]: Uploading piece...
Nov 11 08:10:11.398415378 (48h6m9.949885839s) [upload=42408]: Next returned nil segment
Nov 11 08:10:11.398434043 (48h6m9.949904504s) [upload=42408]: Waiting for error group managing segments...
Nov 11 08:10:11.796154582 (48h6m10.347625043s) [noise=true , address=77.90.31.18:4806 , piece_id=LNL5LRHH3OOELKEO4HND2K3GNVDPCBCGKBNJ75DCLEKRAOMTQLKA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.809043214 (48h6m10.360513675s) [noise=true , address=45.91.116.8:4047 , piece_id=VP6VW2ZTNSKS35R47GGJZI4YSHNNFUFB4YQ3W3QFT5ENN7F73VQA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.866335992 (48h6m10.417806453s) [noise=true , address=45.91.116.11:4117 , piece_id=UOEFPOPOFIO5KXY2JOX54YHUWNMTCAFMXEBKAMMR4GSR5ZE6J6PA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:11.932922087 (48h6m10.484392538s) [noise=true , address=77.90.31.19:4841 , piece_id=6JVB2WIEA2STMNBVTM6D7IYFHQY4QJGXAYHJAQILMYZZDH2MWIVA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:12.005905333 (48h6m10.557375794s) [noise=true , address=45.91.116.4:4939 , piece_id=KMHEQSQTA2WEWMIO7JDQZUDLSRV4CA6OJUN2CYYUSA7SU2ZDQBCQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:16.703757864 (48h6m15.255228326s) [noise=true , address=145.79.227.9:4366 , piece_id=JDBR4PTBZ5RN6NTWPERVLFANUAZQF3FSGIENVRHSYN56ED5NT2AQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:17.540298352 (48h6m16.091768813s) [noise=true , address=145.79.227.21:4474 , piece_id=RNB5T6DIUCY7IV2ULLO2UJRDKUJXI34UM4ZCHPJB22DNQ47VZJVA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:19.805526866 (48h6m18.356997337s) [noise=true , address=145.79.227.27:4689 , piece_id=KLTJYVDWHEE2BGLUSP2XT6L5R2C5OB7TF4DZLYBF6R5OG3N6AEFQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:24.397542313 (48h6m22.949012764s) [noise=true , address=145.79.227.17:4970 , piece_id=F2227LWTX5PRCQIUEJNRJ3QS3GRJOIEJIZFV3KRF7BAEAPSQZR7A, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:24.779686050 (48h6m23.331156511s) [noise=true , address=145.79.227.14:4840 , piece_id=QASWXZB3E6E7VYGF24KZ37Q3LKT6F4WVFKTBV3YS73KYAWTBV7YQ, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:25.298168925 (48h6m23.849639387s) [noise=true , address=145.79.227.11:4729 , piece_id=CDIU7FFPCVQGDK3K5ZDUARJ6VGB7KIY2DEVL7ZRLW5EASIFEHKHA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:35.044925402 (48h6m33.596395853s) [noise=true , address=145.79.227.30:4761 , piece_id=ASO5O5LM6CEF6DXGBVOCI3NOCWLGKDU2T5JHOL5ZPWEXMTRMKZIA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:37.306959937 (48h6m35.858430398s) [noise=true , address=145.79.227.20:4437 , piece_id=AOK6MTRZKPCXTNHZWGBYJGRBYNHFWO7GSG2PT4DFSMDAWK75GY4A, seg_pos={0 0}, upload=42408]: Done uploading piece. err: <nil>
Nov 11 08:10:37.306987550 (48h6m35.858458011s) [seg_pos={0 0}, upload=42408]: Segment reached optimal threshold of 13 pieces.
Nov 11 08:10:37.307209231 (48h6m35.858679702s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF
Nov 11 08:10:37.307218759 (48h6m35.85868922s) [noise=true , address=145.79.227.28:4726 , piece_id=ADS5YQCWYXWSVRAOSHIXR3CDLMWOELEBE3TUVDB4KML4VXESCWPA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307368936 (48h6m35.858839397s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: expected piece hash; context canceled; EOF
Nov 11 08:10:37.307376741 (48h6m35.858847202s) [noise=true , address=145.79.227.25:4617 , piece_id=4RZT3DJ4PSOAKSBGNLV4BZE2MMWEB5677474SIVSSEK6EIQZCXSA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307561282 (48h6m35.859031743s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection; write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46680->145.79.227.22:4510: use of closed network connection
Nov 11 08:10:37.307585969 (48h6m35.85905643s) [noise=true , address=145.79.227.22:4510 , piece_id=NQNGJKB5MZMR7U5DXVBEA6LGGJCVTLHH2HEIVJKI2CS54C4NLQGA, seg_pos={0 0}, upload=42408]: Long tail cancellation due to optimal threshold
Nov 11 08:10:37.307629221 (48h6m35.859099682s) [seg_pos={0 0}, upload=42408]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 11 08:10:37.307741005 (48h6m35.859211466s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 11 08:10:37.307750052 (48h6m35.859220513s) [upload=42408]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 11 08:10:37.612339386 (48h6m36.163809848s) [upload=42408]: Done uploading segments...
Nov 11 08:10:37.612366317 (48h6m36.163836788s) [upload=42408]: Upload finished. err: <nil>
Duration: 30.002492021s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
81.402098ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 08:01:27 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 81.549958ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
61.651708ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 08:00:16 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 61.683799ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [..X............] duration:
72.079645ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:59:40 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 72.107329ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [...X...........] duration:
52.985575ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:58:37 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 53.028177ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [....X..........] duration:
95.039627ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:58:07 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 95.07346ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.....X.........] duration:
54.287625ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:57:10 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 54.311191ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [X.....X........] duration:
72.445132ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:56:51 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 72.476322ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.X.....X.......] duration:
61.967069ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:56:35 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 61.997997ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [..X.....X......] duration:
57.198609ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:55:54 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 57.227273ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [...X.....X.....] duration:
55.144878ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:55:06 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 55.195576ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [....X.....X....] duration:
125.050854ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:54:15 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 125.160623ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.....X.....X...] duration:
101.284197ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:53:02 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 101.319013ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [......X.....X..] duration:
65.432518ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:52:46 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 65.461533ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.......X.....X.] duration:
94.604527ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:52:10 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 94.717092ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [........X.....X] duration:
424.480081ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/4f6d71e3718f99dc
FAIL (2025-11-11 07:51:04 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:47586->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 424.516119ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.........X.....] duration:
80.764102ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/179e15bfc4986d6c
FAIL (2025-11-11 07:50:28 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:59932->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 80.78893ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [..........X....] duration:
96.583847ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/179e15bfc4986d6c
FAIL (2025-11-11 07:49:54 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:59932->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 96.625396ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [...........X...] duration:
75.87859ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/179e15bfc4986d6c
FAIL (2025-11-11 07:48:55 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:59932->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 75.906712ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [............X..] duration:
60.767803ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/179e15bfc4986d6c
FAIL (2025-11-11 07:48:16 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:59932->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 60.79684ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.............X.] duration:
69.996506ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/179e15bfc4986d6c
FAIL (2025-11-11 07:47:38 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:59932->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 70.028208ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [..............X] duration:
6.436911645s remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/179e15bfc4986d6c
FAIL (2025-11-11 07:47:22 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:59932->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 6.436941113s
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
66.473981ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:50:38 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 66.507615ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
105.598031ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:49:32 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 105.612279ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [..X............] duration:
81.971861ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:48:38 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 82.00184ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [...X...........] duration:
49.79516ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:48:19 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 49.833213ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [....X..........] duration:
56.204386ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:47:39 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 56.257856ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
312.559721ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/6dd57ee41eff8af2
FAIL (2025-11-11 06:47:10 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:38352->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 312.660232ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.....X.........] duration:
81.727347ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:47:07 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 81.831775ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [......X........] duration:
99.045093ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:46:37 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 99.076403ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
316.501698ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/6dd57ee41eff8af2
FAIL (2025-11-11 06:46:26 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:38352->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 316.524862ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..X............] duration:
328.08214ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/6dd57ee41eff8af2
FAIL (2025-11-11 06:46:00 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:38352->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 328.129651ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.......X.......] duration:
64.550138ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:45:56 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 64.578992ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [........X......] duration:
84.668307ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:45:37 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 84.702091ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [...X...........] duration:
336.007711ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/6dd57ee41eff8af2
FAIL (2025-11-11 06:45:23 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:38352->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 336.051936ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [X........X.....] duration:
83.292998ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:45:20 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 83.321604ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.X........X....] duration:
103.354579ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:44:52 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 103.383876ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [..X........X...] duration:
56.294296ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:44:19 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 56.349301ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [....X..........] duration:
330.732557ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/6dd57ee41eff8af2
FAIL (2025-11-11 06:44:10 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:38352->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 330.753045ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [...X........X..] duration:
58.82255ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:43:37 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 58.852368ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.....X.........] duration:
323.287941ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/6dd57ee41eff8af2
FAIL (2025-11-11 06:43:04 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:38352->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 323.314131ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [....X........X.] duration:
85.679652ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:43:03 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 85.712574ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.....X........X] duration:
680.906505ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/5c2bc84dd74fce23
FAIL (2025-11-11 06:42:04 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:53326->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 680.936833ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [......X........] duration:
335.486409ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/6dd57ee41eff8af2
FAIL (2025-11-11 06:41:50 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:38352->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 335.534792ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [......X........] duration:
43.956703ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1fe4a77235f5e623
FAIL (2025-11-11 06:41:32 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:60676->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 43.983423ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.......X.......] duration:
67.128328ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1fe4a77235f5e623
FAIL (2025-11-11 06:40:52 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:60676->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 67.167703ms
core
website
|