Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
8.400016018s trace:
https://jaeger.dev.storj.io/trace/43dc1ef093bac9d6
FAIL (2025-11-10 18:01:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
false
Nov 10 17:58:50.195246561 (33h54m48.746717022s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 10 17:58:50.195253364 (33h54m48.746723825s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 10 17:58:50.446150738 (33h54m48.997621199s) [seg_pos={0 0}, upload=29890]: Begin upload segment...
Nov 10 17:58:50.446204921 (33h54m48.997675382s) [seg_pos={0 0}, upload=29890]: Done begin upload segment.
Nov 10 17:58:50.446303128 (33h54m48.997773619s) [noise=true , address=77.90.31.14:4663 , piece_id=K5SDMWGZ5LYQ367MDEPFNKCOWMOEPU6AGOGRPZGZSDI27BK4UQ4Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.446324790 (33h54m48.997795251s) [noise=true , address=45.91.116.8:4045 , piece_id=7AOWQRMD3QXQNGTMYMA4IDYBWNX4ZIRMRXSEZYJ4XRZM6YVIQ5NQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.447279928 (33h54m48.998750389s) [noise=true , address=145.79.227.2:4115 , piece_id=ODSJSZXA5XW5PSARFHFK5IJAJN4X4CLKHI4JEHVMYCBEPP2AG3KA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.447694748 (33h54m48.999165199s) [noise=true , address=145.79.227.5:4221 , piece_id=2GI5X6YJ33EKU7XISGS4DLJ2X34LIVNE6NCZMIF7UIUOTGUHYJNQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448024116 (33h54m48.999494567s) [noise=true , address=77.90.31.18:4805 , piece_id=432T4MFOFSI4XLSBAWTS4KBHDUUAANMAVGBVLNX6LCN52WV2G2UA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448411413 (33h54m48.999881874s) [noise=true , address=77.90.31.17:4772 , piece_id=NUDHKCIIX2EMFTPMIS4Q7K6VOSRT3O7DQGKE6XEHASSMF335W5KA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448773733 (33h54m49.000244184s) [noise=true , address=77.90.31.13:4626 , piece_id=IHYVRGDSJMNIQSQIFRFKFMQ4UISCEK7ALER4K3UIW24Y4WBN2DEA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449192981 (33h54m49.000663442s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449208451 (33h54m49.000678912s) [noise=true , address=145.79.227.32:4835 , piece_id=RFABYRUGXNCCO4GZUCPCJBESQR74YV4MXB3PHJH2MQQC7WU3WHQA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449637497 (33h54m49.001107959s) [noise=true , address=145.79.227.26:4655 , piece_id=TP4GUPIWUC7XXS6FPQD4AIWHDFKBV4CSUIMTP5RLNF5I6MQD3I6Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449875771 (33h54m49.001346232s) [noise=true , address=45.91.116.7:4009 , piece_id=76LEMQOIGP4DGXVJO7BR6BKMBQW4NT7CJVE4KIGUXU6P6HSPJO5A, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450216110 (33h54m49.001686571s) [noise=true , address=145.79.227.9:4367 , piece_id=DB7IT7IS7VU3EFMXUHLXZPGQK5ZD2GLD3KCOOUCKSHGYQVA7AEKA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450394219 (33h54m49.00186468s) [noise=true , address=45.91.116.6:4974 , piece_id=2MCPOHWTLXOHXRFXNF3UEWIFQY7XD3UUMVGE4BH356LP6DI2663Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450853423 (33h54m49.002323874s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.454582924 (33h54m49.006053385s) [noise=true , address=145.79.227.10:4401 , piece_id=X5LBIMPE4K7XWYHWBWU37IN7VSTBXQVSNQXMYBE7H367ZBZCKKVQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.460585405 (33h54m49.012055856s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:52.149625484 (33h54m50.701095945s) [upload=29890]: Next returned nil segment
Nov 10 17:58:52.149643759 (33h54m50.70111423s) [upload=29890]: Waiting for error group managing segments...
Nov 10 17:58:52.555705621 (33h54m51.107176082s) [noise=true , address=77.90.31.18:4805 , piece_id=432T4MFOFSI4XLSBAWTS4KBHDUUAANMAVGBVLNX6LCN52WV2G2UA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.556717748 (33h54m51.108188219s) [noise=true , address=45.91.116.7:4009 , piece_id=76LEMQOIGP4DGXVJO7BR6BKMBQW4NT7CJVE4KIGUXU6P6HSPJO5A, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.557576213 (33h54m51.109046674s) [noise=true , address=77.90.31.17:4772 , piece_id=NUDHKCIIX2EMFTPMIS4Q7K6VOSRT3O7DQGKE6XEHASSMF335W5KA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.576587635 (33h54m51.128058096s) [noise=true , address=45.91.116.6:4974 , piece_id=2MCPOHWTLXOHXRFXNF3UEWIFQY7XD3UUMVGE4BH356LP6DI2663Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.588050924 (33h54m51.139521385s) [noise=true , address=77.90.31.13:4626 , piece_id=IHYVRGDSJMNIQSQIFRFKFMQ4UISCEK7ALER4K3UIW24Y4WBN2DEA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.592877585 (33h54m51.144348046s) [noise=true , address=45.91.116.8:4045 , piece_id=7AOWQRMD3QXQNGTMYMA4IDYBWNX4ZIRMRXSEZYJ4XRZM6YVIQ5NQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.623340614 (33h54m51.174811075s) [noise=true , address=77.90.31.14:4663 , piece_id=K5SDMWGZ5LYQ367MDEPFNKCOWMOEPU6AGOGRPZGZSDI27BK4UQ4Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:57.489476855 (33h54m56.040947306s) [noise=true , address=145.79.227.9:4367 , piece_id=DB7IT7IS7VU3EFMXUHLXZPGQK5ZD2GLD3KCOOUCKSHGYQVA7AEKA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:06.248396761 (33h55m4.799867222s) [noise=true , address=145.79.227.26:4655 , piece_id=TP4GUPIWUC7XXS6FPQD4AIWHDFKBV4CSUIMTP5RLNF5I6MQD3I6Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:09.685941293 (33h55m8.237411754s) [noise=true , address=145.79.227.32:4835 , piece_id=RFABYRUGXNCCO4GZUCPCJBESQR74YV4MXB3PHJH2MQQC7WU3WHQA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:11.118007415 (33h55m9.669477877s) [noise=true , address=145.79.227.10:4401 , piece_id=X5LBIMPE4K7XWYHWBWU37IN7VSTBXQVSNQXMYBE7H367ZBZCKKVQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:11.796179026 (33h55m10.347649487s) [noise=true , address=145.79.227.5:4221 , piece_id=2GI5X6YJ33EKU7XISGS4DLJ2X34LIVNE6NCZMIF7UIUOTGUHYJNQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:19.451686523 (33h55m18.003156984s) [noise=true , address=145.79.227.2:4115 , piece_id=ODSJSZXA5XW5PSARFHFK5IJAJN4X4CLKHI4JEHVMYCBEPP2AG3KA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:19.451715117 (33h55m18.003185588s) [seg_pos={0 0}, upload=29890]: Segment reached optimal threshold of 13 pieces.
Nov 10 17:59:19.451954794 (33h55m18.003425255s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection; write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection
Nov 10 17:59:19.451964883 (33h55m18.003435344s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452454675 (33h55m18.003925136s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection
Nov 10 17:59:19.452468462 (33h55m18.003938923s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452617676 (33h55m18.004088137s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Xy6Y953cfdoyywnf98XTrbd9WuDZNEV8SRhkBKbZRHrU2ymPg): protocol: expected piece hash; write tcp 188.166.225.170:43630->145.79.227.30:4763: use of closed network connection; write tcp 188.166.225.170:43630->145.79.227.30:4763: use of closed network connection; EOF
Nov 10 17:59:19.452627334 (33h55m18.004097795s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452651190 (33h55m18.004121651s) [seg_pos={0 0}, upload=29890]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 10 17:59:19.452756731 (33h55m18.004227192s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 10 17:59:19.452764075 (33h55m18.004234536s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 10 17:59:19.740258739 (33h55m18.29172921s) [upload=29890]: Done uploading segments...
Nov 10 17:59:19.740379268 (33h55m18.291849729s) [upload=29890]: Upload finished. err: metaclient: context deadline exceeded
Duration: 8.400050483s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
12.469543481s trace:
https://jaeger.dev.storj.io/trace/43dc1ef093bac9d6
FAIL (2025-11-10 18:00:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
false
Nov 10 17:58:50.195246561 (33h54m48.746717022s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 10 17:58:50.195253364 (33h54m48.746723825s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 10 17:58:50.446150738 (33h54m48.997621199s) [seg_pos={0 0}, upload=29890]: Begin upload segment...
Nov 10 17:58:50.446204921 (33h54m48.997675382s) [seg_pos={0 0}, upload=29890]: Done begin upload segment.
Nov 10 17:58:50.446303128 (33h54m48.997773619s) [noise=true , address=77.90.31.14:4663 , piece_id=K5SDMWGZ5LYQ367MDEPFNKCOWMOEPU6AGOGRPZGZSDI27BK4UQ4Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.446324790 (33h54m48.997795251s) [noise=true , address=45.91.116.8:4045 , piece_id=7AOWQRMD3QXQNGTMYMA4IDYBWNX4ZIRMRXSEZYJ4XRZM6YVIQ5NQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.447279928 (33h54m48.998750389s) [noise=true , address=145.79.227.2:4115 , piece_id=ODSJSZXA5XW5PSARFHFK5IJAJN4X4CLKHI4JEHVMYCBEPP2AG3KA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.447694748 (33h54m48.999165199s) [noise=true , address=145.79.227.5:4221 , piece_id=2GI5X6YJ33EKU7XISGS4DLJ2X34LIVNE6NCZMIF7UIUOTGUHYJNQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448024116 (33h54m48.999494567s) [noise=true , address=77.90.31.18:4805 , piece_id=432T4MFOFSI4XLSBAWTS4KBHDUUAANMAVGBVLNX6LCN52WV2G2UA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448411413 (33h54m48.999881874s) [noise=true , address=77.90.31.17:4772 , piece_id=NUDHKCIIX2EMFTPMIS4Q7K6VOSRT3O7DQGKE6XEHASSMF335W5KA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448773733 (33h54m49.000244184s) [noise=true , address=77.90.31.13:4626 , piece_id=IHYVRGDSJMNIQSQIFRFKFMQ4UISCEK7ALER4K3UIW24Y4WBN2DEA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449192981 (33h54m49.000663442s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449208451 (33h54m49.000678912s) [noise=true , address=145.79.227.32:4835 , piece_id=RFABYRUGXNCCO4GZUCPCJBESQR74YV4MXB3PHJH2MQQC7WU3WHQA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449637497 (33h54m49.001107959s) [noise=true , address=145.79.227.26:4655 , piece_id=TP4GUPIWUC7XXS6FPQD4AIWHDFKBV4CSUIMTP5RLNF5I6MQD3I6Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449875771 (33h54m49.001346232s) [noise=true , address=45.91.116.7:4009 , piece_id=76LEMQOIGP4DGXVJO7BR6BKMBQW4NT7CJVE4KIGUXU6P6HSPJO5A, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450216110 (33h54m49.001686571s) [noise=true , address=145.79.227.9:4367 , piece_id=DB7IT7IS7VU3EFMXUHLXZPGQK5ZD2GLD3KCOOUCKSHGYQVA7AEKA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450394219 (33h54m49.00186468s) [noise=true , address=45.91.116.6:4974 , piece_id=2MCPOHWTLXOHXRFXNF3UEWIFQY7XD3UUMVGE4BH356LP6DI2663Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450853423 (33h54m49.002323874s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.454582924 (33h54m49.006053385s) [noise=true , address=145.79.227.10:4401 , piece_id=X5LBIMPE4K7XWYHWBWU37IN7VSTBXQVSNQXMYBE7H367ZBZCKKVQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.460585405 (33h54m49.012055856s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:52.149625484 (33h54m50.701095945s) [upload=29890]: Next returned nil segment
Nov 10 17:58:52.149643759 (33h54m50.70111423s) [upload=29890]: Waiting for error group managing segments...
Nov 10 17:58:52.555705621 (33h54m51.107176082s) [noise=true , address=77.90.31.18:4805 , piece_id=432T4MFOFSI4XLSBAWTS4KBHDUUAANMAVGBVLNX6LCN52WV2G2UA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.556717748 (33h54m51.108188219s) [noise=true , address=45.91.116.7:4009 , piece_id=76LEMQOIGP4DGXVJO7BR6BKMBQW4NT7CJVE4KIGUXU6P6HSPJO5A, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.557576213 (33h54m51.109046674s) [noise=true , address=77.90.31.17:4772 , piece_id=NUDHKCIIX2EMFTPMIS4Q7K6VOSRT3O7DQGKE6XEHASSMF335W5KA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.576587635 (33h54m51.128058096s) [noise=true , address=45.91.116.6:4974 , piece_id=2MCPOHWTLXOHXRFXNF3UEWIFQY7XD3UUMVGE4BH356LP6DI2663Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.588050924 (33h54m51.139521385s) [noise=true , address=77.90.31.13:4626 , piece_id=IHYVRGDSJMNIQSQIFRFKFMQ4UISCEK7ALER4K3UIW24Y4WBN2DEA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.592877585 (33h54m51.144348046s) [noise=true , address=45.91.116.8:4045 , piece_id=7AOWQRMD3QXQNGTMYMA4IDYBWNX4ZIRMRXSEZYJ4XRZM6YVIQ5NQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.623340614 (33h54m51.174811075s) [noise=true , address=77.90.31.14:4663 , piece_id=K5SDMWGZ5LYQ367MDEPFNKCOWMOEPU6AGOGRPZGZSDI27BK4UQ4Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:57.489476855 (33h54m56.040947306s) [noise=true , address=145.79.227.9:4367 , piece_id=DB7IT7IS7VU3EFMXUHLXZPGQK5ZD2GLD3KCOOUCKSHGYQVA7AEKA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:06.248396761 (33h55m4.799867222s) [noise=true , address=145.79.227.26:4655 , piece_id=TP4GUPIWUC7XXS6FPQD4AIWHDFKBV4CSUIMTP5RLNF5I6MQD3I6Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:09.685941293 (33h55m8.237411754s) [noise=true , address=145.79.227.32:4835 , piece_id=RFABYRUGXNCCO4GZUCPCJBESQR74YV4MXB3PHJH2MQQC7WU3WHQA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:11.118007415 (33h55m9.669477877s) [noise=true , address=145.79.227.10:4401 , piece_id=X5LBIMPE4K7XWYHWBWU37IN7VSTBXQVSNQXMYBE7H367ZBZCKKVQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:11.796179026 (33h55m10.347649487s) [noise=true , address=145.79.227.5:4221 , piece_id=2GI5X6YJ33EKU7XISGS4DLJ2X34LIVNE6NCZMIF7UIUOTGUHYJNQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:19.451686523 (33h55m18.003156984s) [noise=true , address=145.79.227.2:4115 , piece_id=ODSJSZXA5XW5PSARFHFK5IJAJN4X4CLKHI4JEHVMYCBEPP2AG3KA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:19.451715117 (33h55m18.003185588s) [seg_pos={0 0}, upload=29890]: Segment reached optimal threshold of 13 pieces.
Nov 10 17:59:19.451954794 (33h55m18.003425255s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection; write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection
Nov 10 17:59:19.451964883 (33h55m18.003435344s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452454675 (33h55m18.003925136s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection
Nov 10 17:59:19.452468462 (33h55m18.003938923s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452617676 (33h55m18.004088137s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Xy6Y953cfdoyywnf98XTrbd9WuDZNEV8SRhkBKbZRHrU2ymPg): protocol: expected piece hash; write tcp 188.166.225.170:43630->145.79.227.30:4763: use of closed network connection; write tcp 188.166.225.170:43630->145.79.227.30:4763: use of closed network connection; EOF
Nov 10 17:59:19.452627334 (33h55m18.004097795s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452651190 (33h55m18.004121651s) [seg_pos={0 0}, upload=29890]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 10 17:59:19.452756731 (33h55m18.004227192s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 10 17:59:19.452764075 (33h55m18.004234536s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 10 17:59:19.740258739 (33h55m18.29172921s) [upload=29890]: Done uploading segments...
Nov 10 17:59:19.740379268 (33h55m18.291849729s) [upload=29890]: Upload finished. err: metaclient: context deadline exceeded
Duration: 12.469566635s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
10.261184653s trace:
https://jaeger.dev.storj.io/trace/43dc1ef093bac9d6
FAIL (2025-11-10 17:59:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
false
Nov 10 17:58:50.195246561 (33h54m48.746717022s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 10 17:58:50.195253364 (33h54m48.746723825s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 10 17:58:50.446150738 (33h54m48.997621199s) [seg_pos={0 0}, upload=29890]: Begin upload segment...
Nov 10 17:58:50.446204921 (33h54m48.997675382s) [seg_pos={0 0}, upload=29890]: Done begin upload segment.
Nov 10 17:58:50.446303128 (33h54m48.997773619s) [noise=true , address=77.90.31.14:4663 , piece_id=K5SDMWGZ5LYQ367MDEPFNKCOWMOEPU6AGOGRPZGZSDI27BK4UQ4Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.446324790 (33h54m48.997795251s) [noise=true , address=45.91.116.8:4045 , piece_id=7AOWQRMD3QXQNGTMYMA4IDYBWNX4ZIRMRXSEZYJ4XRZM6YVIQ5NQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.447279928 (33h54m48.998750389s) [noise=true , address=145.79.227.2:4115 , piece_id=ODSJSZXA5XW5PSARFHFK5IJAJN4X4CLKHI4JEHVMYCBEPP2AG3KA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.447694748 (33h54m48.999165199s) [noise=true , address=145.79.227.5:4221 , piece_id=2GI5X6YJ33EKU7XISGS4DLJ2X34LIVNE6NCZMIF7UIUOTGUHYJNQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448024116 (33h54m48.999494567s) [noise=true , address=77.90.31.18:4805 , piece_id=432T4MFOFSI4XLSBAWTS4KBHDUUAANMAVGBVLNX6LCN52WV2G2UA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448411413 (33h54m48.999881874s) [noise=true , address=77.90.31.17:4772 , piece_id=NUDHKCIIX2EMFTPMIS4Q7K6VOSRT3O7DQGKE6XEHASSMF335W5KA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448773733 (33h54m49.000244184s) [noise=true , address=77.90.31.13:4626 , piece_id=IHYVRGDSJMNIQSQIFRFKFMQ4UISCEK7ALER4K3UIW24Y4WBN2DEA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449192981 (33h54m49.000663442s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449208451 (33h54m49.000678912s) [noise=true , address=145.79.227.32:4835 , piece_id=RFABYRUGXNCCO4GZUCPCJBESQR74YV4MXB3PHJH2MQQC7WU3WHQA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449637497 (33h54m49.001107959s) [noise=true , address=145.79.227.26:4655 , piece_id=TP4GUPIWUC7XXS6FPQD4AIWHDFKBV4CSUIMTP5RLNF5I6MQD3I6Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449875771 (33h54m49.001346232s) [noise=true , address=45.91.116.7:4009 , piece_id=76LEMQOIGP4DGXVJO7BR6BKMBQW4NT7CJVE4KIGUXU6P6HSPJO5A, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450216110 (33h54m49.001686571s) [noise=true , address=145.79.227.9:4367 , piece_id=DB7IT7IS7VU3EFMXUHLXZPGQK5ZD2GLD3KCOOUCKSHGYQVA7AEKA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450394219 (33h54m49.00186468s) [noise=true , address=45.91.116.6:4974 , piece_id=2MCPOHWTLXOHXRFXNF3UEWIFQY7XD3UUMVGE4BH356LP6DI2663Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450853423 (33h54m49.002323874s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.454582924 (33h54m49.006053385s) [noise=true , address=145.79.227.10:4401 , piece_id=X5LBIMPE4K7XWYHWBWU37IN7VSTBXQVSNQXMYBE7H367ZBZCKKVQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.460585405 (33h54m49.012055856s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:52.149625484 (33h54m50.701095945s) [upload=29890]: Next returned nil segment
Nov 10 17:58:52.149643759 (33h54m50.70111423s) [upload=29890]: Waiting for error group managing segments...
Nov 10 17:58:52.555705621 (33h54m51.107176082s) [noise=true , address=77.90.31.18:4805 , piece_id=432T4MFOFSI4XLSBAWTS4KBHDUUAANMAVGBVLNX6LCN52WV2G2UA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.556717748 (33h54m51.108188219s) [noise=true , address=45.91.116.7:4009 , piece_id=76LEMQOIGP4DGXVJO7BR6BKMBQW4NT7CJVE4KIGUXU6P6HSPJO5A, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.557576213 (33h54m51.109046674s) [noise=true , address=77.90.31.17:4772 , piece_id=NUDHKCIIX2EMFTPMIS4Q7K6VOSRT3O7DQGKE6XEHASSMF335W5KA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.576587635 (33h54m51.128058096s) [noise=true , address=45.91.116.6:4974 , piece_id=2MCPOHWTLXOHXRFXNF3UEWIFQY7XD3UUMVGE4BH356LP6DI2663Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.588050924 (33h54m51.139521385s) [noise=true , address=77.90.31.13:4626 , piece_id=IHYVRGDSJMNIQSQIFRFKFMQ4UISCEK7ALER4K3UIW24Y4WBN2DEA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.592877585 (33h54m51.144348046s) [noise=true , address=45.91.116.8:4045 , piece_id=7AOWQRMD3QXQNGTMYMA4IDYBWNX4ZIRMRXSEZYJ4XRZM6YVIQ5NQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.623340614 (33h54m51.174811075s) [noise=true , address=77.90.31.14:4663 , piece_id=K5SDMWGZ5LYQ367MDEPFNKCOWMOEPU6AGOGRPZGZSDI27BK4UQ4Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:57.489476855 (33h54m56.040947306s) [noise=true , address=145.79.227.9:4367 , piece_id=DB7IT7IS7VU3EFMXUHLXZPGQK5ZD2GLD3KCOOUCKSHGYQVA7AEKA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:06.248396761 (33h55m4.799867222s) [noise=true , address=145.79.227.26:4655 , piece_id=TP4GUPIWUC7XXS6FPQD4AIWHDFKBV4CSUIMTP5RLNF5I6MQD3I6Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:09.685941293 (33h55m8.237411754s) [noise=true , address=145.79.227.32:4835 , piece_id=RFABYRUGXNCCO4GZUCPCJBESQR74YV4MXB3PHJH2MQQC7WU3WHQA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:11.118007415 (33h55m9.669477877s) [noise=true , address=145.79.227.10:4401 , piece_id=X5LBIMPE4K7XWYHWBWU37IN7VSTBXQVSNQXMYBE7H367ZBZCKKVQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:11.796179026 (33h55m10.347649487s) [noise=true , address=145.79.227.5:4221 , piece_id=2GI5X6YJ33EKU7XISGS4DLJ2X34LIVNE6NCZMIF7UIUOTGUHYJNQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:19.451686523 (33h55m18.003156984s) [noise=true , address=145.79.227.2:4115 , piece_id=ODSJSZXA5XW5PSARFHFK5IJAJN4X4CLKHI4JEHVMYCBEPP2AG3KA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:19.451715117 (33h55m18.003185588s) [seg_pos={0 0}, upload=29890]: Segment reached optimal threshold of 13 pieces.
Nov 10 17:59:19.451954794 (33h55m18.003425255s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection; write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection
Nov 10 17:59:19.451964883 (33h55m18.003435344s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452454675 (33h55m18.003925136s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection
Nov 10 17:59:19.452468462 (33h55m18.003938923s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452617676 (33h55m18.004088137s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Xy6Y953cfdoyywnf98XTrbd9WuDZNEV8SRhkBKbZRHrU2ymPg): protocol: expected piece hash; write tcp 188.166.225.170:43630->145.79.227.30:4763: use of closed network connection; write tcp 188.166.225.170:43630->145.79.227.30:4763: use of closed network connection; EOF
Nov 10 17:59:19.452627334 (33h55m18.004097795s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452651190 (33h55m18.004121651s) [seg_pos={0 0}, upload=29890]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 10 17:59:19.452756731 (33h55m18.004227192s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 10 17:59:19.452764075 (33h55m18.004234536s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 10 17:59:19.740258739 (33h55m18.29172921s) [upload=29890]: Done uploading segments...
Nov 10 17:59:19.740379268 (33h55m18.291849729s) [upload=29890]: Upload finished. err: metaclient: context deadline exceeded
Duration: 10.261205624s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.256216842s trace:
https://jaeger.dev.storj.io/trace/43dc1ef093bac9d6
FAIL (2025-11-10 17:59:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
false
Nov 10 17:58:50.195246561 (33h54m48.746717022s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 10 17:58:50.195253364 (33h54m48.746723825s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 10 17:58:50.446150738 (33h54m48.997621199s) [seg_pos={0 0}, upload=29890]: Begin upload segment...
Nov 10 17:58:50.446204921 (33h54m48.997675382s) [seg_pos={0 0}, upload=29890]: Done begin upload segment.
Nov 10 17:58:50.446303128 (33h54m48.997773619s) [noise=true , address=77.90.31.14:4663 , piece_id=K5SDMWGZ5LYQ367MDEPFNKCOWMOEPU6AGOGRPZGZSDI27BK4UQ4Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.446324790 (33h54m48.997795251s) [noise=true , address=45.91.116.8:4045 , piece_id=7AOWQRMD3QXQNGTMYMA4IDYBWNX4ZIRMRXSEZYJ4XRZM6YVIQ5NQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.447279928 (33h54m48.998750389s) [noise=true , address=145.79.227.2:4115 , piece_id=ODSJSZXA5XW5PSARFHFK5IJAJN4X4CLKHI4JEHVMYCBEPP2AG3KA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.447694748 (33h54m48.999165199s) [noise=true , address=145.79.227.5:4221 , piece_id=2GI5X6YJ33EKU7XISGS4DLJ2X34LIVNE6NCZMIF7UIUOTGUHYJNQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448024116 (33h54m48.999494567s) [noise=true , address=77.90.31.18:4805 , piece_id=432T4MFOFSI4XLSBAWTS4KBHDUUAANMAVGBVLNX6LCN52WV2G2UA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448411413 (33h54m48.999881874s) [noise=true , address=77.90.31.17:4772 , piece_id=NUDHKCIIX2EMFTPMIS4Q7K6VOSRT3O7DQGKE6XEHASSMF335W5KA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.448773733 (33h54m49.000244184s) [noise=true , address=77.90.31.13:4626 , piece_id=IHYVRGDSJMNIQSQIFRFKFMQ4UISCEK7ALER4K3UIW24Y4WBN2DEA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449192981 (33h54m49.000663442s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449208451 (33h54m49.000678912s) [noise=true , address=145.79.227.32:4835 , piece_id=RFABYRUGXNCCO4GZUCPCJBESQR74YV4MXB3PHJH2MQQC7WU3WHQA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449637497 (33h54m49.001107959s) [noise=true , address=145.79.227.26:4655 , piece_id=TP4GUPIWUC7XXS6FPQD4AIWHDFKBV4CSUIMTP5RLNF5I6MQD3I6Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.449875771 (33h54m49.001346232s) [noise=true , address=45.91.116.7:4009 , piece_id=76LEMQOIGP4DGXVJO7BR6BKMBQW4NT7CJVE4KIGUXU6P6HSPJO5A, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450216110 (33h54m49.001686571s) [noise=true , address=145.79.227.9:4367 , piece_id=DB7IT7IS7VU3EFMXUHLXZPGQK5ZD2GLD3KCOOUCKSHGYQVA7AEKA, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450394219 (33h54m49.00186468s) [noise=true , address=45.91.116.6:4974 , piece_id=2MCPOHWTLXOHXRFXNF3UEWIFQY7XD3UUMVGE4BH356LP6DI2663Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.450853423 (33h54m49.002323874s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.454582924 (33h54m49.006053385s) [noise=true , address=145.79.227.10:4401 , piece_id=X5LBIMPE4K7XWYHWBWU37IN7VSTBXQVSNQXMYBE7H367ZBZCKKVQ, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:50.460585405 (33h54m49.012055856s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Uploading piece...
Nov 10 17:58:52.149625484 (33h54m50.701095945s) [upload=29890]: Next returned nil segment
Nov 10 17:58:52.149643759 (33h54m50.70111423s) [upload=29890]: Waiting for error group managing segments...
Nov 10 17:58:52.555705621 (33h54m51.107176082s) [noise=true , address=77.90.31.18:4805 , piece_id=432T4MFOFSI4XLSBAWTS4KBHDUUAANMAVGBVLNX6LCN52WV2G2UA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.556717748 (33h54m51.108188219s) [noise=true , address=45.91.116.7:4009 , piece_id=76LEMQOIGP4DGXVJO7BR6BKMBQW4NT7CJVE4KIGUXU6P6HSPJO5A, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.557576213 (33h54m51.109046674s) [noise=true , address=77.90.31.17:4772 , piece_id=NUDHKCIIX2EMFTPMIS4Q7K6VOSRT3O7DQGKE6XEHASSMF335W5KA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.576587635 (33h54m51.128058096s) [noise=true , address=45.91.116.6:4974 , piece_id=2MCPOHWTLXOHXRFXNF3UEWIFQY7XD3UUMVGE4BH356LP6DI2663Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.588050924 (33h54m51.139521385s) [noise=true , address=77.90.31.13:4626 , piece_id=IHYVRGDSJMNIQSQIFRFKFMQ4UISCEK7ALER4K3UIW24Y4WBN2DEA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.592877585 (33h54m51.144348046s) [noise=true , address=45.91.116.8:4045 , piece_id=7AOWQRMD3QXQNGTMYMA4IDYBWNX4ZIRMRXSEZYJ4XRZM6YVIQ5NQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:52.623340614 (33h54m51.174811075s) [noise=true , address=77.90.31.14:4663 , piece_id=K5SDMWGZ5LYQ367MDEPFNKCOWMOEPU6AGOGRPZGZSDI27BK4UQ4Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:58:57.489476855 (33h54m56.040947306s) [noise=true , address=145.79.227.9:4367 , piece_id=DB7IT7IS7VU3EFMXUHLXZPGQK5ZD2GLD3KCOOUCKSHGYQVA7AEKA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:06.248396761 (33h55m4.799867222s) [noise=true , address=145.79.227.26:4655 , piece_id=TP4GUPIWUC7XXS6FPQD4AIWHDFKBV4CSUIMTP5RLNF5I6MQD3I6Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:09.685941293 (33h55m8.237411754s) [noise=true , address=145.79.227.32:4835 , piece_id=RFABYRUGXNCCO4GZUCPCJBESQR74YV4MXB3PHJH2MQQC7WU3WHQA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:11.118007415 (33h55m9.669477877s) [noise=true , address=145.79.227.10:4401 , piece_id=X5LBIMPE4K7XWYHWBWU37IN7VSTBXQVSNQXMYBE7H367ZBZCKKVQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:11.796179026 (33h55m10.347649487s) [noise=true , address=145.79.227.5:4221 , piece_id=2GI5X6YJ33EKU7XISGS4DLJ2X34LIVNE6NCZMIF7UIUOTGUHYJNQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:19.451686523 (33h55m18.003156984s) [noise=true , address=145.79.227.2:4115 , piece_id=ODSJSZXA5XW5PSARFHFK5IJAJN4X4CLKHI4JEHVMYCBEPP2AG3KA, seg_pos={0 0}, upload=29890]: Done uploading piece. err: <nil>
Nov 10 17:59:19.451715117 (33h55m18.003185588s) [seg_pos={0 0}, upload=29890]: Segment reached optimal threshold of 13 pieces.
Nov 10 17:59:19.451954794 (33h55m18.003425255s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection; write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56452->145.79.227.17:4971: use of closed network connection
Nov 10 17:59:19.451964883 (33h55m18.003435344s) [noise=true , address=145.79.227.17:4971 , piece_id=4Q77MAZ3LE7S5JKQW72H5P7YQL4SLHFKEMP3XC4VXJYYVTBA3IVQ, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452454675 (33h55m18.003925136s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection; write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55722->145.79.227.15:4876: use of closed network connection
Nov 10 17:59:19.452468462 (33h55m18.003938923s) [noise=true , address=145.79.227.15:4876 , piece_id=MW2FFRZE3NS47F6J7BH7J2SFROV7YT4T3WC3D2ECRYO7GY655E6Q, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452617676 (33h55m18.004088137s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Xy6Y953cfdoyywnf98XTrbd9WuDZNEV8SRhkBKbZRHrU2ymPg): protocol: expected piece hash; write tcp 188.166.225.170:43630->145.79.227.30:4763: use of closed network connection; write tcp 188.166.225.170:43630->145.79.227.30:4763: use of closed network connection; EOF
Nov 10 17:59:19.452627334 (33h55m18.004097795s) [noise=true , address=145.79.227.30:4763 , piece_id=HAZUMU2MFCWMN22NA3Z46YBLHRGD3V2N4VQYLTUYEPKL5YGSBL7Q, seg_pos={0 0}, upload=29890]: Long tail cancellation due to optimal threshold
Nov 10 17:59:19.452651190 (33h55m18.004121651s) [seg_pos={0 0}, upload=29890]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Nov 10 17:59:19.452756731 (33h55m18.004227192s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 10 17:59:19.452764075 (33h55m18.004234536s) [upload=29890]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 10 17:59:19.740258739 (33h55m18.29172921s) [upload=29890]: Done uploading segments...
Nov 10 17:59:19.740379268 (33h55m18.291849729s) [upload=29890]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.256233212s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
312.990184ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:58:52 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 313.09327ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
349.083595ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:57:51 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 349.132266ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..X............] duration:
329.584982ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:57:03 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 329.616623ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [...X...........] duration:
305.10114ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:55:54 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 305.128143ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [....X..........] duration:
324.128141ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:55:00 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 324.157599ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.....X.........] duration:
326.725608ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:54:04 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 326.760625ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [......X........] duration:
293.274008ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:53:38 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 293.299195ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.......X.......] duration:
325.628199ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:52:57 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 325.661822ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [........X......] duration:
318.32424ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:52:38 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 318.701038ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.........X.....] duration:
322.205741ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:51:41 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 322.252981ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..........X....] duration:
335.858249ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:51:17 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 335.891173ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [...........X...] duration:
327.479021ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:50:40 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 327.527854ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [............X..] duration:
315.96161ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:49:55 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 316.046422ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.............X.] duration:
349.955984ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:49:22 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 349.983597ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..............X] duration:
440.766578ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/23bddbe83836379b
FAIL (2025-11-10 17:49:06 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:57524->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 440.809289ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
338.740978ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:37:00 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 338.776847ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
328.741518ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:35:49 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 328.762177ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..X............] duration:
352.393817ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:35:27 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 352.428663ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [...X...........] duration:
328.163907ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:34:23 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 328.19223ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [....X..........] duration:
305.682818ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:33:32 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 305.723486ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.....X.........] duration:
314.61719ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:32:37 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 314.665503ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [......X........] duration:
322.450588ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:32:21 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 322.479534ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.......X.......] duration:
345.637121ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:31:39 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 345.667158ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [........X......] duration:
332.701568ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:31:11 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 332.725764ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.........X.....] duration:
328.820026ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:30:46 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 328.974471ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..........X....] duration:
307.244059ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:29:43 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 307.288454ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [...........X...] duration:
346.5038ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:28:31 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 346.539469ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [............X..] duration:
608.254541ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:27:43 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 608.278077ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.............X.] duration:
319.100007ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:26:54 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 319.127659ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..............X] duration:
640.986041ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/b54232fa5875a61
FAIL (2025-11-10 17:26:09 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:58820->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 641.016529ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
56.01772ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:45:58 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 56.047136ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
63.036827ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:44:51 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 63.125726ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [..X............] duration:
56.621691ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:44:19 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 56.69441ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [...X...........] duration:
373.096965ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:43:23 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 373.127132ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [....X..........] duration:
63.762469ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:42:55 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 63.793037ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.....X.........] duration:
62.653957ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:42:16 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 62.687221ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [......X........] duration:
77.890321ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:41:19 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 77.919166ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
321.076914ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/225be40bb40c7c6
FAIL (2025-11-10 16:40:41 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:41076->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 321.107021ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.......X.......] duration:
64.804131ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:40:30 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 64.833087ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [........X......] duration:
67.132988ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:39:40 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 67.168204ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
613.226003ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/225be40bb40c7c6
FAIL (2025-11-10 16:39:28 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:41076->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 613.261541ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.........X.....] duration:
59.512305ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:39:23 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 59.541901ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [..X............] duration:
328.30632ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/225be40bb40c7c6
FAIL (2025-11-10 16:38:59 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:41076->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 328.324014ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [..........X....] duration:
53.462716ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/ trace:
https://jaeger.dev.storj.io/trace/ed2265d0340c2b2
FAIL (2025-11-10 16:38:34 UTC)
orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:39402->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 53.489386ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [...X...........] duration:
307.670556ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/225be40bb40c7c6
FAIL (2025-11-10 16:38:33 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:41076->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 307.705801ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [....X..........] duration:
628.122019ms remote:
"tcp:[2620:cb:2000::1]:443" target:
https://www.storj.io/dcs-satellites trace:
https://jaeger.dev.storj.io/trace/225be40bb40c7c6
FAIL (2025-11-10 16:38:11 UTC)
orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:41076->[2620:cb:2000::1]:443: read: connection reset by peer
Duration: 628.210136ms
core
website
|