Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [.X..........................................X.......X.......] duration:
3.488246262s trace:
https://jaeger.dev.storj.io/trace/71a223f8d367c9d8
FAIL (2025-11-30 14:09:25 UTC)
orbiter warning: context deadline exceeded
Duration: 3.488276009s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.77324973s trace:
https://jaeger.dev.storj.io/trace/657a298d72a1dcb7
FAIL (2025-11-30 14:08:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
582s) [noise=true , address=145.79.227.44:4193 , piece_id=IRC6ECVPRA2LQRTOX2DIRQJWTRZHLSJC7CR5UWM6H3UZDK6EXP4A, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.822498353 (510h2m14.373968814s) [noise=true , address=45.91.116.5:4298 , piece_id=JOWT7R3PLXA2CSXIPTKSESLEXQNZHZRJYF7LNNTJWVNVYS4XUMYQ, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.822919635 (510h2m14.374390106s) [noise=true , address=145.79.227.13:4803 , piece_id=TOP7RYT56WCL57JYDHFH3TCDAIB463PV574AN34QIP4Z2QZ4H4UA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.823149052 (510h2m14.374619513s) [noise=true , address=145.79.227.14:4837 , piece_id=HRVTRZMN26BOPKFLDEMGQGLWXUOMUFY7SEVTNTBJCGZUHCMHDSNA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.823439715 (510h2m14.374910166s) [noise=true , address=45.91.116.13:4153 , piece_id=2F2NA4ZKZLKXZZM3IROT4OTLJI5KEJCBLQZJIGMSS7YI5XYGVREA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.824058944 (510h2m14.375529405s) [noise=true , address=145.79.227.11:4732 , piece_id=RNEHYHFQGVCT5SQXI5S56KKYHUE4D5GODGHASR3JSDUEQLWCPKAA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:17.641631834 (510h2m16.193102295s) [upload=449157]: Next returned nil segment
Nov 30 14:06:17.641649628 (510h2m16.193120089s) [upload=449157]: Waiting for error group managing segments...
Nov 30 14:06:17.961591160 (510h2m16.513061621s) [noise=true , address=45.91.116.6:4973 , piece_id=YZIPW5BAFLW6B3K5FYEA2TUQKGRNYMNWXP36DKYBRX3OOHQERTYA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:17.985403504 (510h2m16.536873965s) [noise=true , address=45.91.116.13:4153 , piece_id=2F2NA4ZKZLKXZZM3IROT4OTLJI5KEJCBLQZJIGMSS7YI5XYGVREA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:17.988791976 (510h2m16.540262427s) [noise=true , address=45.91.116.5:4298 , piece_id=JOWT7R3PLXA2CSXIPTKSESLEXQNZHZRJYF7LNNTJWVNVYS4XUMYQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:44.864740849 (510h2m43.41621131s) [noise=true , address=145.79.227.30:4762 , piece_id=HCB4MXJFWV5N77RMKDGNA2KYLY7IEB2F57JBITUOQ5I3OX6O6WIA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection; write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection
Nov 30 14:06:44.864768752 (510h2m43.416239213s) [noise=true , address=145.79.227.22:4510 , piece_id=HZTR57BAQGRH64TGGKV3L62TVMHD2XOB7OQ7EOYZWYDI4HCZUUKQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9, address:145.79.227.22:4510): protocol: write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection; write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection
Nov 30 14:06:44.864954365 (510h2m43.416424826s) [noise=true , address=145.79.227.13:4803 , piece_id=TOP7RYT56WCL57JYDHFH3TCDAIB463PV574AN34QIP4Z2QZ4H4UA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection
Nov 30 14:06:44.865000753 (510h2m43.416471214s) [noise=true , address=145.79.227.21:4473 , piece_id=VKC3KNRSYIUYILWXAERZZQ4WPZSRUKZDAMRHLSZBBK4LVWR444DQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection; write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection
Nov 30 14:06:44.865045529 (510h2m43.41651598s) [noise=true , address=145.79.227.26:4655 , piece_id=3OZ3COXW53Z6VZXCIRVLIKNWRAWXNG7JW3H4TD4Q4CKFEQGEG3WA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection; write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection
Nov 30 14:06:44.865124840 (510h2m43.416595311s) [noise=true , address=145.79.227.4:4186 , piece_id=Q3GO3O7WKKRLMU5ZIST6WGFFLKDBXJYNF3URLGBAGGN2VTJQPOYA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection
Nov 30 14:06:44.865152884 (510h2m43.416623335s) [noise=true , address=145.79.227.34:4907 , piece_id=5W43MRSPRBDPQ4VB4HBO4RN3G2BABVMUXF473QNHRQL4TPE4U5LA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS, address:145.79.227.34:4907): protocol: write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection; write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection
Nov 30 14:06:44.865222386 (510h2m43.416692847s) [noise=true , address=145.79.227.14:4837 , piece_id=HRVTRZMN26BOPKFLDEMGQGLWXUOMUFY7SEVTNTBJCGZUHCMHDSNA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection
Nov 30 14:06:44.865282800 (510h2m43.416753251s) [noise=true , address=145.79.227.11:4732 , piece_id=RNEHYHFQGVCT5SQXI5S56KKYHUE4D5GODGHASR3JSDUEQLWCPKAA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection
Nov 30 14:06:44.865535031 (510h2m43.417005482s) [noise=true , address=145.79.227.10:4402 , piece_id=FURED6JNT6HLPEI5H6AZWP6QSWVYLOZ2FLAMAF5QKKFNLOSBEDQA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: read tcp 188.166.225.170:44888->145.79.227.10:4402: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865639651 (510h2m43.417110112s) [noise=true , address=145.79.227.12:4765 , piece_id=N6DJ4TM22WVZO56FE76IQLIYS6W7QKL3JJY553HIHHTIC6FFDRKA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV, address:145.79.227.12:4765): protocol: read tcp 188.166.225.170:53870->145.79.227.12:4765: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865769788 (510h2m43.417240249s) [noise=true , address=145.79.227.44:4193 , piece_id=IRC6ECVPRA2LQRTOX2DIRQJWTRZHLSJC7CR5UWM6H3UZDK6EXP4A, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8, address:145.79.227.44:4193): protocol: read tcp 188.166.225.170:33090->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865779507 (510h2m43.417249968s) [noise=true , address=145.79.227.18:4006 , piece_id=AL3BDZ6OXKXM2KJSBMA7IYQEXW725Y575PESGFMJLGZHLEJSE3SA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: read tcp 188.166.225.170:34566->145.79.227.18:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865853979 (510h2m43.41732443s) [seg_pos={0 0}, upload=449157]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Nov 30 14:06:45.115762223 (510h2m43.667232684s) [upload=449157]: Done uploading segments...
Nov 30 14:06:45.115801749 (510h2m43.66727221s) [upload=449157]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 5.773276021s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [..X..........................................X.......X......] duration:
3.639457088s trace:
https://jaeger.dev.storj.io/trace/71a223f8d367c9d8
FAIL (2025-11-30 14:08:45 UTC)
orbiter warning: context deadline exceeded
Duration: 3.639485833s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.845998457s trace:
https://jaeger.dev.storj.io/trace/657a298d72a1dcb7
FAIL (2025-11-30 14:07:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
582s) [noise=true , address=145.79.227.44:4193 , piece_id=IRC6ECVPRA2LQRTOX2DIRQJWTRZHLSJC7CR5UWM6H3UZDK6EXP4A, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.822498353 (510h2m14.373968814s) [noise=true , address=45.91.116.5:4298 , piece_id=JOWT7R3PLXA2CSXIPTKSESLEXQNZHZRJYF7LNNTJWVNVYS4XUMYQ, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.822919635 (510h2m14.374390106s) [noise=true , address=145.79.227.13:4803 , piece_id=TOP7RYT56WCL57JYDHFH3TCDAIB463PV574AN34QIP4Z2QZ4H4UA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.823149052 (510h2m14.374619513s) [noise=true , address=145.79.227.14:4837 , piece_id=HRVTRZMN26BOPKFLDEMGQGLWXUOMUFY7SEVTNTBJCGZUHCMHDSNA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.823439715 (510h2m14.374910166s) [noise=true , address=45.91.116.13:4153 , piece_id=2F2NA4ZKZLKXZZM3IROT4OTLJI5KEJCBLQZJIGMSS7YI5XYGVREA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.824058944 (510h2m14.375529405s) [noise=true , address=145.79.227.11:4732 , piece_id=RNEHYHFQGVCT5SQXI5S56KKYHUE4D5GODGHASR3JSDUEQLWCPKAA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:17.641631834 (510h2m16.193102295s) [upload=449157]: Next returned nil segment
Nov 30 14:06:17.641649628 (510h2m16.193120089s) [upload=449157]: Waiting for error group managing segments...
Nov 30 14:06:17.961591160 (510h2m16.513061621s) [noise=true , address=45.91.116.6:4973 , piece_id=YZIPW5BAFLW6B3K5FYEA2TUQKGRNYMNWXP36DKYBRX3OOHQERTYA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:17.985403504 (510h2m16.536873965s) [noise=true , address=45.91.116.13:4153 , piece_id=2F2NA4ZKZLKXZZM3IROT4OTLJI5KEJCBLQZJIGMSS7YI5XYGVREA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:17.988791976 (510h2m16.540262427s) [noise=true , address=45.91.116.5:4298 , piece_id=JOWT7R3PLXA2CSXIPTKSESLEXQNZHZRJYF7LNNTJWVNVYS4XUMYQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:44.864740849 (510h2m43.41621131s) [noise=true , address=145.79.227.30:4762 , piece_id=HCB4MXJFWV5N77RMKDGNA2KYLY7IEB2F57JBITUOQ5I3OX6O6WIA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection; write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection
Nov 30 14:06:44.864768752 (510h2m43.416239213s) [noise=true , address=145.79.227.22:4510 , piece_id=HZTR57BAQGRH64TGGKV3L62TVMHD2XOB7OQ7EOYZWYDI4HCZUUKQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9, address:145.79.227.22:4510): protocol: write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection; write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection
Nov 30 14:06:44.864954365 (510h2m43.416424826s) [noise=true , address=145.79.227.13:4803 , piece_id=TOP7RYT56WCL57JYDHFH3TCDAIB463PV574AN34QIP4Z2QZ4H4UA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection
Nov 30 14:06:44.865000753 (510h2m43.416471214s) [noise=true , address=145.79.227.21:4473 , piece_id=VKC3KNRSYIUYILWXAERZZQ4WPZSRUKZDAMRHLSZBBK4LVWR444DQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection; write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection
Nov 30 14:06:44.865045529 (510h2m43.41651598s) [noise=true , address=145.79.227.26:4655 , piece_id=3OZ3COXW53Z6VZXCIRVLIKNWRAWXNG7JW3H4TD4Q4CKFEQGEG3WA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection; write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection
Nov 30 14:06:44.865124840 (510h2m43.416595311s) [noise=true , address=145.79.227.4:4186 , piece_id=Q3GO3O7WKKRLMU5ZIST6WGFFLKDBXJYNF3URLGBAGGN2VTJQPOYA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection
Nov 30 14:06:44.865152884 (510h2m43.416623335s) [noise=true , address=145.79.227.34:4907 , piece_id=5W43MRSPRBDPQ4VB4HBO4RN3G2BABVMUXF473QNHRQL4TPE4U5LA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS, address:145.79.227.34:4907): protocol: write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection; write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection
Nov 30 14:06:44.865222386 (510h2m43.416692847s) [noise=true , address=145.79.227.14:4837 , piece_id=HRVTRZMN26BOPKFLDEMGQGLWXUOMUFY7SEVTNTBJCGZUHCMHDSNA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection
Nov 30 14:06:44.865282800 (510h2m43.416753251s) [noise=true , address=145.79.227.11:4732 , piece_id=RNEHYHFQGVCT5SQXI5S56KKYHUE4D5GODGHASR3JSDUEQLWCPKAA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection
Nov 30 14:06:44.865535031 (510h2m43.417005482s) [noise=true , address=145.79.227.10:4402 , piece_id=FURED6JNT6HLPEI5H6AZWP6QSWVYLOZ2FLAMAF5QKKFNLOSBEDQA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: read tcp 188.166.225.170:44888->145.79.227.10:4402: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865639651 (510h2m43.417110112s) [noise=true , address=145.79.227.12:4765 , piece_id=N6DJ4TM22WVZO56FE76IQLIYS6W7QKL3JJY553HIHHTIC6FFDRKA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV, address:145.79.227.12:4765): protocol: read tcp 188.166.225.170:53870->145.79.227.12:4765: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865769788 (510h2m43.417240249s) [noise=true , address=145.79.227.44:4193 , piece_id=IRC6ECVPRA2LQRTOX2DIRQJWTRZHLSJC7CR5UWM6H3UZDK6EXP4A, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8, address:145.79.227.44:4193): protocol: read tcp 188.166.225.170:33090->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865779507 (510h2m43.417249968s) [noise=true , address=145.79.227.18:4006 , piece_id=AL3BDZ6OXKXM2KJSBMA7IYQEXW725Y575PESGFMJLGZHLEJSE3SA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: read tcp 188.166.225.170:34566->145.79.227.18:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865853979 (510h2m43.41732443s) [seg_pos={0 0}, upload=449157]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Nov 30 14:06:45.115762223 (510h2m43.667232684s) [upload=449157]: Done uploading segments...
Nov 30 14:06:45.115801749 (510h2m43.66727221s) [upload=449157]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 5.846062882s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [...X..........................................X.......X.....] duration:
3.338520421s trace:
https://jaeger.dev.storj.io/trace/71a223f8d367c9d8
FAIL (2025-11-30 14:07:45 UTC)
orbiter warning: context deadline exceeded
Duration: 3.338543565s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.902688859s trace:
https://jaeger.dev.storj.io/trace/657a298d72a1dcb7
FAIL (2025-11-30 14:07:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
582s) [noise=true , address=145.79.227.44:4193 , piece_id=IRC6ECVPRA2LQRTOX2DIRQJWTRZHLSJC7CR5UWM6H3UZDK6EXP4A, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.822498353 (510h2m14.373968814s) [noise=true , address=45.91.116.5:4298 , piece_id=JOWT7R3PLXA2CSXIPTKSESLEXQNZHZRJYF7LNNTJWVNVYS4XUMYQ, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.822919635 (510h2m14.374390106s) [noise=true , address=145.79.227.13:4803 , piece_id=TOP7RYT56WCL57JYDHFH3TCDAIB463PV574AN34QIP4Z2QZ4H4UA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.823149052 (510h2m14.374619513s) [noise=true , address=145.79.227.14:4837 , piece_id=HRVTRZMN26BOPKFLDEMGQGLWXUOMUFY7SEVTNTBJCGZUHCMHDSNA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.823439715 (510h2m14.374910166s) [noise=true , address=45.91.116.13:4153 , piece_id=2F2NA4ZKZLKXZZM3IROT4OTLJI5KEJCBLQZJIGMSS7YI5XYGVREA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.824058944 (510h2m14.375529405s) [noise=true , address=145.79.227.11:4732 , piece_id=RNEHYHFQGVCT5SQXI5S56KKYHUE4D5GODGHASR3JSDUEQLWCPKAA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:17.641631834 (510h2m16.193102295s) [upload=449157]: Next returned nil segment
Nov 30 14:06:17.641649628 (510h2m16.193120089s) [upload=449157]: Waiting for error group managing segments...
Nov 30 14:06:17.961591160 (510h2m16.513061621s) [noise=true , address=45.91.116.6:4973 , piece_id=YZIPW5BAFLW6B3K5FYEA2TUQKGRNYMNWXP36DKYBRX3OOHQERTYA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:17.985403504 (510h2m16.536873965s) [noise=true , address=45.91.116.13:4153 , piece_id=2F2NA4ZKZLKXZZM3IROT4OTLJI5KEJCBLQZJIGMSS7YI5XYGVREA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:17.988791976 (510h2m16.540262427s) [noise=true , address=45.91.116.5:4298 , piece_id=JOWT7R3PLXA2CSXIPTKSESLEXQNZHZRJYF7LNNTJWVNVYS4XUMYQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:44.864740849 (510h2m43.41621131s) [noise=true , address=145.79.227.30:4762 , piece_id=HCB4MXJFWV5N77RMKDGNA2KYLY7IEB2F57JBITUOQ5I3OX6O6WIA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection; write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection
Nov 30 14:06:44.864768752 (510h2m43.416239213s) [noise=true , address=145.79.227.22:4510 , piece_id=HZTR57BAQGRH64TGGKV3L62TVMHD2XOB7OQ7EOYZWYDI4HCZUUKQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9, address:145.79.227.22:4510): protocol: write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection; write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection
Nov 30 14:06:44.864954365 (510h2m43.416424826s) [noise=true , address=145.79.227.13:4803 , piece_id=TOP7RYT56WCL57JYDHFH3TCDAIB463PV574AN34QIP4Z2QZ4H4UA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection
Nov 30 14:06:44.865000753 (510h2m43.416471214s) [noise=true , address=145.79.227.21:4473 , piece_id=VKC3KNRSYIUYILWXAERZZQ4WPZSRUKZDAMRHLSZBBK4LVWR444DQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection; write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection
Nov 30 14:06:44.865045529 (510h2m43.41651598s) [noise=true , address=145.79.227.26:4655 , piece_id=3OZ3COXW53Z6VZXCIRVLIKNWRAWXNG7JW3H4TD4Q4CKFEQGEG3WA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection; write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection
Nov 30 14:06:44.865124840 (510h2m43.416595311s) [noise=true , address=145.79.227.4:4186 , piece_id=Q3GO3O7WKKRLMU5ZIST6WGFFLKDBXJYNF3URLGBAGGN2VTJQPOYA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection
Nov 30 14:06:44.865152884 (510h2m43.416623335s) [noise=true , address=145.79.227.34:4907 , piece_id=5W43MRSPRBDPQ4VB4HBO4RN3G2BABVMUXF473QNHRQL4TPE4U5LA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS, address:145.79.227.34:4907): protocol: write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection; write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection
Nov 30 14:06:44.865222386 (510h2m43.416692847s) [noise=true , address=145.79.227.14:4837 , piece_id=HRVTRZMN26BOPKFLDEMGQGLWXUOMUFY7SEVTNTBJCGZUHCMHDSNA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection
Nov 30 14:06:44.865282800 (510h2m43.416753251s) [noise=true , address=145.79.227.11:4732 , piece_id=RNEHYHFQGVCT5SQXI5S56KKYHUE4D5GODGHASR3JSDUEQLWCPKAA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection
Nov 30 14:06:44.865535031 (510h2m43.417005482s) [noise=true , address=145.79.227.10:4402 , piece_id=FURED6JNT6HLPEI5H6AZWP6QSWVYLOZ2FLAMAF5QKKFNLOSBEDQA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: read tcp 188.166.225.170:44888->145.79.227.10:4402: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865639651 (510h2m43.417110112s) [noise=true , address=145.79.227.12:4765 , piece_id=N6DJ4TM22WVZO56FE76IQLIYS6W7QKL3JJY553HIHHTIC6FFDRKA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV, address:145.79.227.12:4765): protocol: read tcp 188.166.225.170:53870->145.79.227.12:4765: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865769788 (510h2m43.417240249s) [noise=true , address=145.79.227.44:4193 , piece_id=IRC6ECVPRA2LQRTOX2DIRQJWTRZHLSJC7CR5UWM6H3UZDK6EXP4A, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8, address:145.79.227.44:4193): protocol: read tcp 188.166.225.170:33090->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865779507 (510h2m43.417249968s) [noise=true , address=145.79.227.18:4006 , piece_id=AL3BDZ6OXKXM2KJSBMA7IYQEXW725Y575PESGFMJLGZHLEJSE3SA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: read tcp 188.166.225.170:34566->145.79.227.18:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865853979 (510h2m43.41732443s) [seg_pos={0 0}, upload=449157]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Nov 30 14:06:45.115762223 (510h2m43.667232684s) [upload=449157]: Done uploading segments...
Nov 30 14:06:45.115801749 (510h2m43.66727221s) [upload=449157]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 5.902802385s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [....X..........................................X.......X....] duration:
3.399248463s trace:
https://jaeger.dev.storj.io/trace/71a223f8d367c9d8
FAIL (2025-11-30 14:07:21 UTC)
orbiter warning: context deadline exceeded
Duration: 3.399278711s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.840733294s trace:
https://jaeger.dev.storj.io/trace/657a298d72a1dcb7
FAIL (2025-11-30 14:07:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
582s) [noise=true , address=145.79.227.44:4193 , piece_id=IRC6ECVPRA2LQRTOX2DIRQJWTRZHLSJC7CR5UWM6H3UZDK6EXP4A, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.822498353 (510h2m14.373968814s) [noise=true , address=45.91.116.5:4298 , piece_id=JOWT7R3PLXA2CSXIPTKSESLEXQNZHZRJYF7LNNTJWVNVYS4XUMYQ, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.822919635 (510h2m14.374390106s) [noise=true , address=145.79.227.13:4803 , piece_id=TOP7RYT56WCL57JYDHFH3TCDAIB463PV574AN34QIP4Z2QZ4H4UA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.823149052 (510h2m14.374619513s) [noise=true , address=145.79.227.14:4837 , piece_id=HRVTRZMN26BOPKFLDEMGQGLWXUOMUFY7SEVTNTBJCGZUHCMHDSNA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.823439715 (510h2m14.374910166s) [noise=true , address=45.91.116.13:4153 , piece_id=2F2NA4ZKZLKXZZM3IROT4OTLJI5KEJCBLQZJIGMSS7YI5XYGVREA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.824058944 (510h2m14.375529405s) [noise=true , address=145.79.227.11:4732 , piece_id=RNEHYHFQGVCT5SQXI5S56KKYHUE4D5GODGHASR3JSDUEQLWCPKAA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:17.641631834 (510h2m16.193102295s) [upload=449157]: Next returned nil segment
Nov 30 14:06:17.641649628 (510h2m16.193120089s) [upload=449157]: Waiting for error group managing segments...
Nov 30 14:06:17.961591160 (510h2m16.513061621s) [noise=true , address=45.91.116.6:4973 , piece_id=YZIPW5BAFLW6B3K5FYEA2TUQKGRNYMNWXP36DKYBRX3OOHQERTYA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:17.985403504 (510h2m16.536873965s) [noise=true , address=45.91.116.13:4153 , piece_id=2F2NA4ZKZLKXZZM3IROT4OTLJI5KEJCBLQZJIGMSS7YI5XYGVREA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:17.988791976 (510h2m16.540262427s) [noise=true , address=45.91.116.5:4298 , piece_id=JOWT7R3PLXA2CSXIPTKSESLEXQNZHZRJYF7LNNTJWVNVYS4XUMYQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:44.864740849 (510h2m43.41621131s) [noise=true , address=145.79.227.30:4762 , piece_id=HCB4MXJFWV5N77RMKDGNA2KYLY7IEB2F57JBITUOQ5I3OX6O6WIA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection; write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection
Nov 30 14:06:44.864768752 (510h2m43.416239213s) [noise=true , address=145.79.227.22:4510 , piece_id=HZTR57BAQGRH64TGGKV3L62TVMHD2XOB7OQ7EOYZWYDI4HCZUUKQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9, address:145.79.227.22:4510): protocol: write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection; write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection
Nov 30 14:06:44.864954365 (510h2m43.416424826s) [noise=true , address=145.79.227.13:4803 , piece_id=TOP7RYT56WCL57JYDHFH3TCDAIB463PV574AN34QIP4Z2QZ4H4UA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection
Nov 30 14:06:44.865000753 (510h2m43.416471214s) [noise=true , address=145.79.227.21:4473 , piece_id=VKC3KNRSYIUYILWXAERZZQ4WPZSRUKZDAMRHLSZBBK4LVWR444DQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection; write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection
Nov 30 14:06:44.865045529 (510h2m43.41651598s) [noise=true , address=145.79.227.26:4655 , piece_id=3OZ3COXW53Z6VZXCIRVLIKNWRAWXNG7JW3H4TD4Q4CKFEQGEG3WA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection; write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection
Nov 30 14:06:44.865124840 (510h2m43.416595311s) [noise=true , address=145.79.227.4:4186 , piece_id=Q3GO3O7WKKRLMU5ZIST6WGFFLKDBXJYNF3URLGBAGGN2VTJQPOYA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection
Nov 30 14:06:44.865152884 (510h2m43.416623335s) [noise=true , address=145.79.227.34:4907 , piece_id=5W43MRSPRBDPQ4VB4HBO4RN3G2BABVMUXF473QNHRQL4TPE4U5LA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS, address:145.79.227.34:4907): protocol: write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection; write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection
Nov 30 14:06:44.865222386 (510h2m43.416692847s) [noise=true , address=145.79.227.14:4837 , piece_id=HRVTRZMN26BOPKFLDEMGQGLWXUOMUFY7SEVTNTBJCGZUHCMHDSNA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection
Nov 30 14:06:44.865282800 (510h2m43.416753251s) [noise=true , address=145.79.227.11:4732 , piece_id=RNEHYHFQGVCT5SQXI5S56KKYHUE4D5GODGHASR3JSDUEQLWCPKAA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection
Nov 30 14:06:44.865535031 (510h2m43.417005482s) [noise=true , address=145.79.227.10:4402 , piece_id=FURED6JNT6HLPEI5H6AZWP6QSWVYLOZ2FLAMAF5QKKFNLOSBEDQA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: read tcp 188.166.225.170:44888->145.79.227.10:4402: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865639651 (510h2m43.417110112s) [noise=true , address=145.79.227.12:4765 , piece_id=N6DJ4TM22WVZO56FE76IQLIYS6W7QKL3JJY553HIHHTIC6FFDRKA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV, address:145.79.227.12:4765): protocol: read tcp 188.166.225.170:53870->145.79.227.12:4765: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865769788 (510h2m43.417240249s) [noise=true , address=145.79.227.44:4193 , piece_id=IRC6ECVPRA2LQRTOX2DIRQJWTRZHLSJC7CR5UWM6H3UZDK6EXP4A, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8, address:145.79.227.44:4193): protocol: read tcp 188.166.225.170:33090->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865779507 (510h2m43.417249968s) [noise=true , address=145.79.227.18:4006 , piece_id=AL3BDZ6OXKXM2KJSBMA7IYQEXW725Y575PESGFMJLGZHLEJSE3SA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: read tcp 188.166.225.170:34566->145.79.227.18:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865853979 (510h2m43.41732443s) [seg_pos={0 0}, upload=449157]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Nov 30 14:06:45.115762223 (510h2m43.667232684s) [upload=449157]: Done uploading segments...
Nov 30 14:06:45.115801749 (510h2m43.66727221s) [upload=449157]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 5.84076223s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.252662966s trace:
https://jaeger.dev.storj.io/trace/657a298d72a1dcb7
FAIL (2025-11-30 14:06:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
582s) [noise=true , address=145.79.227.44:4193 , piece_id=IRC6ECVPRA2LQRTOX2DIRQJWTRZHLSJC7CR5UWM6H3UZDK6EXP4A, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.822498353 (510h2m14.373968814s) [noise=true , address=45.91.116.5:4298 , piece_id=JOWT7R3PLXA2CSXIPTKSESLEXQNZHZRJYF7LNNTJWVNVYS4XUMYQ, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.822919635 (510h2m14.374390106s) [noise=true , address=145.79.227.13:4803 , piece_id=TOP7RYT56WCL57JYDHFH3TCDAIB463PV574AN34QIP4Z2QZ4H4UA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.823149052 (510h2m14.374619513s) [noise=true , address=145.79.227.14:4837 , piece_id=HRVTRZMN26BOPKFLDEMGQGLWXUOMUFY7SEVTNTBJCGZUHCMHDSNA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.823439715 (510h2m14.374910166s) [noise=true , address=45.91.116.13:4153 , piece_id=2F2NA4ZKZLKXZZM3IROT4OTLJI5KEJCBLQZJIGMSS7YI5XYGVREA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:15.824058944 (510h2m14.375529405s) [noise=true , address=145.79.227.11:4732 , piece_id=RNEHYHFQGVCT5SQXI5S56KKYHUE4D5GODGHASR3JSDUEQLWCPKAA, seg_pos={0 0}, upload=449157]: Uploading piece...
Nov 30 14:06:17.641631834 (510h2m16.193102295s) [upload=449157]: Next returned nil segment
Nov 30 14:06:17.641649628 (510h2m16.193120089s) [upload=449157]: Waiting for error group managing segments...
Nov 30 14:06:17.961591160 (510h2m16.513061621s) [noise=true , address=45.91.116.6:4973 , piece_id=YZIPW5BAFLW6B3K5FYEA2TUQKGRNYMNWXP36DKYBRX3OOHQERTYA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:17.985403504 (510h2m16.536873965s) [noise=true , address=45.91.116.13:4153 , piece_id=2F2NA4ZKZLKXZZM3IROT4OTLJI5KEJCBLQZJIGMSS7YI5XYGVREA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:17.988791976 (510h2m16.540262427s) [noise=true , address=45.91.116.5:4298 , piece_id=JOWT7R3PLXA2CSXIPTKSESLEXQNZHZRJYF7LNNTJWVNVYS4XUMYQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: <nil>
Nov 30 14:06:44.864740849 (510h2m43.41621131s) [noise=true , address=145.79.227.30:4762 , piece_id=HCB4MXJFWV5N77RMKDGNA2KYLY7IEB2F57JBITUOQ5I3OX6O6WIA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection; write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46986->145.79.227.30:4762: use of closed network connection
Nov 30 14:06:44.864768752 (510h2m43.416239213s) [noise=true , address=145.79.227.22:4510 , piece_id=HZTR57BAQGRH64TGGKV3L62TVMHD2XOB7OQ7EOYZWYDI4HCZUUKQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9, address:145.79.227.22:4510): protocol: write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection; write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52034->145.79.227.22:4510: use of closed network connection
Nov 30 14:06:44.864954365 (510h2m43.416424826s) [noise=true , address=145.79.227.13:4803 , piece_id=TOP7RYT56WCL57JYDHFH3TCDAIB463PV574AN34QIP4Z2QZ4H4UA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection; write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56910->145.79.227.13:4803: use of closed network connection
Nov 30 14:06:44.865000753 (510h2m43.416471214s) [noise=true , address=145.79.227.21:4473 , piece_id=VKC3KNRSYIUYILWXAERZZQ4WPZSRUKZDAMRHLSZBBK4LVWR444DQ, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection; write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60114->145.79.227.21:4473: use of closed network connection
Nov 30 14:06:44.865045529 (510h2m43.41651598s) [noise=true , address=145.79.227.26:4655 , piece_id=3OZ3COXW53Z6VZXCIRVLIKNWRAWXNG7JW3H4TD4Q4CKFEQGEG3WA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection; write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37290->145.79.227.26:4655: use of closed network connection
Nov 30 14:06:44.865124840 (510h2m43.416595311s) [noise=true , address=145.79.227.4:4186 , piece_id=Q3GO3O7WKKRLMU5ZIST6WGFFLKDBXJYNF3URLGBAGGN2VTJQPOYA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection; write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32954->145.79.227.4:4186: use of closed network connection
Nov 30 14:06:44.865152884 (510h2m43.416623335s) [noise=true , address=145.79.227.34:4907 , piece_id=5W43MRSPRBDPQ4VB4HBO4RN3G2BABVMUXF473QNHRQL4TPE4U5LA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS, address:145.79.227.34:4907): protocol: write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection; write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56062->145.79.227.34:4907: use of closed network connection
Nov 30 14:06:44.865222386 (510h2m43.416692847s) [noise=true , address=145.79.227.14:4837 , piece_id=HRVTRZMN26BOPKFLDEMGQGLWXUOMUFY7SEVTNTBJCGZUHCMHDSNA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection; write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37098->145.79.227.14:4837: use of closed network connection
Nov 30 14:06:44.865282800 (510h2m43.416753251s) [noise=true , address=145.79.227.11:4732 , piece_id=RNEHYHFQGVCT5SQXI5S56KKYHUE4D5GODGHASR3JSDUEQLWCPKAA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection; write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36654->145.79.227.11:4732: use of closed network connection
Nov 30 14:06:44.865535031 (510h2m43.417005482s) [noise=true , address=145.79.227.10:4402 , piece_id=FURED6JNT6HLPEI5H6AZWP6QSWVYLOZ2FLAMAF5QKKFNLOSBEDQA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: read tcp 188.166.225.170:44888->145.79.227.10:4402: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865639651 (510h2m43.417110112s) [noise=true , address=145.79.227.12:4765 , piece_id=N6DJ4TM22WVZO56FE76IQLIYS6W7QKL3JJY553HIHHTIC6FFDRKA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV, address:145.79.227.12:4765): protocol: read tcp 188.166.225.170:53870->145.79.227.12:4765: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865769788 (510h2m43.417240249s) [noise=true , address=145.79.227.44:4193 , piece_id=IRC6ECVPRA2LQRTOX2DIRQJWTRZHLSJC7CR5UWM6H3UZDK6EXP4A, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8, address:145.79.227.44:4193): protocol: read tcp 188.166.225.170:33090->145.79.227.44:4193: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865779507 (510h2m43.417249968s) [noise=true , address=145.79.227.18:4006 , piece_id=AL3BDZ6OXKXM2KJSBMA7IYQEXW725Y575PESGFMJLGZHLEJSE3SA, seg_pos={0 0}, upload=449157]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: read tcp 188.166.225.170:34566->145.79.227.18:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 30 14:06:44.865853979 (510h2m43.41732443s) [seg_pos={0 0}, upload=449157]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Nov 30 14:06:45.115762223 (510h2m43.667232684s) [upload=449157]: Done uploading segments...
Nov 30 14:06:45.115801749 (510h2m43.66727221s) [upload=449157]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 30.252697241s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [.....X..........................................X.......X...] duration:
3.659524081s trace:
https://jaeger.dev.storj.io/trace/71a223f8d367c9d8
FAIL (2025-11-30 14:06:14 UTC)
orbiter warning: context deadline exceeded
Duration: 3.659555311s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [......X..........................................X.......X..] duration:
3.477495391s trace:
https://jaeger.dev.storj.io/trace/71a223f8d367c9d8
FAIL (2025-11-30 14:05:21 UTC)
orbiter warning: context deadline exceeded
Duration: 3.477533363s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [.......X..........................................X.......X.] duration:
3.482423874s trace:
https://jaeger.dev.storj.io/trace/71a223f8d367c9d8
FAIL (2025-11-30 14:04:27 UTC)
orbiter warning: context deadline exceeded
Duration: 3.482450685s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [........X..........................................X.......X] duration:
5.000838981s trace:
https://jaeger.dev.storj.io/trace/71a223f8d367c9d8
FAIL (2025-11-30 14:03:41 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000859179s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.........X..........................................X.......] duration:
3.549377157s trace:
https://jaeger.dev.storj.io/trace/1716375406018c40
FAIL (2025-11-30 14:02:25 UTC)
orbiter warning: context deadline exceeded
Duration: 3.549396735s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..........X..........................................X......] duration:
3.473017075s trace:
https://jaeger.dev.storj.io/trace/1716375406018c40
FAIL (2025-11-30 14:01:46 UTC)
orbiter warning: context deadline exceeded
Duration: 3.473039687s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [...........X..........................................X.....] duration:
3.479516108s trace:
https://jaeger.dev.storj.io/trace/1716375406018c40
FAIL (2025-11-30 14:01:13 UTC)
orbiter warning: context deadline exceeded
Duration: 3.479551065s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [............X..........................................X....] duration:
3.782577618s trace:
https://jaeger.dev.storj.io/trace/1716375406018c40
FAIL (2025-11-30 14:00:52 UTC)
orbiter warning: context deadline exceeded
Duration: 3.782608566s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.............X..........................................X...] duration:
3.442744961s trace:
https://jaeger.dev.storj.io/trace/1716375406018c40
FAIL (2025-11-30 13:59:39 UTC)
orbiter warning: context deadline exceeded
Duration: 3.442770661s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..............X..........................................X..] duration:
3.741392053s trace:
https://jaeger.dev.storj.io/trace/1716375406018c40
FAIL (2025-11-30 13:59:17 UTC)
orbiter warning: context deadline exceeded
Duration: 3.741423394s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [...............X..........................................X.] duration:
3.47661723s trace:
https://jaeger.dev.storj.io/trace/1716375406018c40
FAIL (2025-11-30 13:58:43 UTC)
orbiter warning: context deadline exceeded
Duration: 3.476632027s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [................X..........................................X] duration:
5.00096728s trace:
https://jaeger.dev.storj.io/trace/1716375406018c40
FAIL (2025-11-30 13:58:11 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001075385s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
3.658290573s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:57:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.6583213s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
3.734767509s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:56:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.734794209s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
3.461556469s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:55:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.461579483s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
3.635451468s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:54:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.63548372s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
3.502430467s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:53:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.502461666s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
4.514543085s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:53:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.51457247s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
3.492836962s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:53:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.492865127s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
3.709821271s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:52:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.70993087s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
3.751865773s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:51:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.751978717s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................] duration:
3.503089475s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:50:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.50311822s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................] duration:
3.358536638s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:49:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.358566804s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
3.423071592s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:48:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.423084726s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
3.405030651s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:47:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.405056401s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
3.393133656s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:47:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.393207225s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
4.937302402s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:46:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.937367115s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
3.67286362s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:45:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.672961195s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
3.599419186s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:45:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.599518685s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [X.................................X.........................] duration:
5.001410122s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:43:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001436281s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.X.................................X........................] duration:
3.702504821s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:43:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.702536011s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..X.................................X.......................] duration:
3.69332977s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:42:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.693360129s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [...X.................................X......................] duration:
3.519205633s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:42:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.519235972s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [....X.................................X.....................] duration:
3.455996039s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:41:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.456028903s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.....X.................................X....................] duration:
3.567495223s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:40:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.567524358s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [......X.................................X...................] duration:
4.542878873s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:39:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.542903339s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.......X.................................X..................] duration:
4.390100993s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:39:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.39013621s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [........X.................................X.................] duration:
3.419697811s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:38:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.419719642s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.........X.................................X................] duration:
3.646555778s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:37:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.646577139s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..........X.................................X...............] duration:
3.624993709s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:36:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.625052051s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [...........X.................................X..............] duration:
3.338263891s trace:
https://jaeger.dev.storj.io/trace/5744695e70d57650
FAIL (2025-11-30 13:36:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.338294329s
core
uplink
us-select-1
us1-placement-20
|