Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [..............X.............X.......XX........X.............] duration:
3.443730314s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:15:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.443763607s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
12.087392579s trace:
https://jaeger.dev.storj.io/trace/6f1ff10066b1d8ea
FAIL (2025-12-09 02:15:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
rue , address=185.167.204.206:4052 , piece_id=WY7PGT7EC5IUBTSHFEAMHXONCIKPFPRF3Y4YSL2IJNY2MOO6U7HA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.223188835 (82h32m5.09427188s) [noise=true , address=89.149.201.147:4011 , piece_id=I77RBTAA7KPTBE27RPPPCNYU65WBBUORVCNYAJOV5OHOBGUFEJKA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.223808365 (82h32m5.09489141s) [noise=true , address=185.167.204.206:4050 , piece_id=YKLEM6U44VR3GM45KKKJF7JYOFA4YQE6P5UAZZEMXIA2LBZW5UKA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.224324407 (82h32m5.095407452s) [noise=true , address=185.167.204.205:4011 , piece_id=6JR2JQYKTRLCSBJDUWWSJ6CRYGWKWN3AW3KJCPXMYLYPUN6W2DRQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.224877841 (82h32m5.095960886s) [noise=true , address=81.171.14.70:4032 , piece_id=APFBMO7KRDDWH6WT3H4ZLCXBAAMZTZQYQBN3XX6JZDGOBAMSGVCA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.225476030 (82h32m5.096559075s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.226119545 (82h32m5.09720258s) [noise=true , address=89.149.201.147:4015 , piece_id=XBCH6ONGHITOZ2Z5GDPPKDV45TILCDFTOZ44OKMSZANCGVBGQ7ZQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.226816121 (82h32m5.097899166s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.227549758 (82h32m5.098632813s) [noise=true , address=185.167.204.206:4067 , piece_id=PK6GGQNT4DQ2ZMF2IEEO5X32IMA26ULKDN7HAAG4CWOC2UAUKMMA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.228376403 (82h32m5.099459448s) [noise=true , address=81.171.14.70:4046 , piece_id=RR4RRWZ6YO3EK62O7TE2QUC3ZJ762VGUTVXVVHPGMQRPWEFTB7VA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.228990242 (82h32m5.100073297s) [noise=true , address=185.167.204.205:4013 , piece_id=7TBB5J7PYW23YFBOESEZ5Q6YOD3FKALVJMUQRMC5JSQ5JYKGDQSA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:06.054905806 (82h32m5.925988851s) [upload=72112]: Next returned nil segment
Dec 9 02:01:06.054930403 (82h32m5.926013448s) [upload=72112]: Waiting for error group managing segments...
Dec 9 02:01:06.441184862 (82h32m6.312267897s) [noise=true , address=185.167.204.205:4004 , piece_id=6CC2A4V4TJPRJBN4IMJ7VGDVFYTJIVY6J3ZIPZWYL5TIBLGT744A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.444455871 (82h32m6.315538916s) [noise=true , address=185.167.204.205:4005 , piece_id=QUO2YNK2MJJ63CKWADK5K64GYKHDOSBPFHKYKQSKH2TJQUZTNEVA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.447822552 (82h32m6.318905597s) [noise=true , address=185.167.204.206:4066 , piece_id=SSGUSCBUP2YNFN7OMUZQIXJJMSHV6GDHQYMN475LJFQQ7SV2FV2A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.451954059 (82h32m6.323037104s) [noise=true , address=185.167.204.205:4008 , piece_id=54IT2P63UNQKCHG4HB7CX7UWJFWDLJXXPOGPNAEN36ZAC4UQ6VQQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.454212810 (82h32m6.325295856s) [noise=true , address=185.167.204.205:4011 , piece_id=6JR2JQYKTRLCSBJDUWWSJ6CRYGWKWN3AW3KJCPXMYLYPUN6W2DRQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.454331416 (82h32m6.325414461s) [noise=true , address=185.167.204.206:4052 , piece_id=WY7PGT7EC5IUBTSHFEAMHXONCIKPFPRF3Y4YSL2IJNY2MOO6U7HA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.455138002 (82h32m6.326221047s) [noise=true , address=185.167.204.206:4050 , piece_id=YKLEM6U44VR3GM45KKKJF7JYOFA4YQE6P5UAZZEMXIA2LBZW5UKA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.459504045 (82h32m6.33058709s) [noise=true , address=185.167.204.205:4013 , piece_id=7TBB5J7PYW23YFBOESEZ5Q6YOD3FKALVJMUQRMC5JSQ5JYKGDQSA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.465474574 (82h32m6.336557629s) [noise=true , address=185.167.204.206:4067 , piece_id=PK6GGQNT4DQ2ZMF2IEEO5X32IMA26ULKDN7HAAG4CWOC2UAUKMMA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.060075359 (82h32m6.931158404s) [noise=true , address=81.171.14.70:4034 , piece_id=DNHPDP5YCQLS5AN6OHWRWVOGOIGE53YB7CJVUHNPJK35AEM455GQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.111399558 (82h32m6.982482603s) [noise=true , address=81.171.14.70:4026 , piece_id=CRRJW4OCPQUSWT6BERGQJPYYQ4DHSZIBMIBCD22QWCGGHUISCFXQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.133611052 (82h32m7.004694097s) [noise=true , address=81.171.14.70:4032 , piece_id=APFBMO7KRDDWH6WT3H4ZLCXBAAMZTZQYQBN3XX6JZDGOBAMSGVCA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.149778297 (82h32m7.020861342s) [noise=true , address=81.171.14.70:4030 , piece_id=VOYOWF6Y5DZOJ6DLW6QFYUI6DF5YA7FI4VI57LHMNCZ2PZLRY4BQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.243693687 (82h32m7.114776732s) [noise=true , address=81.171.14.70:4040 , piece_id=RYDZ6DCJ3Z5YKJPIFMLR7EHPH55S7HABKAJCKGRGHF2TCRKEYHXQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.624315751 (82h32m7.495398796s) [noise=true , address=81.171.14.70:4046 , piece_id=RR4RRWZ6YO3EK62O7TE2QUC3ZJ762VGUTVXVVHPGMQRPWEFTB7VA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.682160867 (82h32m7.553243912s) [noise=true , address=89.149.201.147:4011 , piece_id=I77RBTAA7KPTBE27RPPPCNYU65WBBUORVCNYAJOV5OHOBGUFEJKA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.704962114 (82h32m7.576045159s) [noise=true , address=89.149.201.147:4003 , piece_id=KQDYYB3S7PMHBAZTSQDATYYBAUYHMHEQDI6PW4GM4HKXBK4XHIVQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.723657624 (82h32m7.594740669s) [noise=true , address=89.149.201.147:4008 , piece_id=JCJNV47ZC7LJPXSERGUXP2QRLHVPOAQNOPI25RQZTA52IYKRZK4Q, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.729409366 (82h32m7.600492411s) [noise=true , address=89.149.201.147:4002 , piece_id=YFUKN6FRXESUYMS6ZV53MCQTZV5UXYHFF72WS2XJWGF3K3I72GTQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.761878943 (82h32m7.632961988s) [noise=true , address=89.149.201.147:4004 , piece_id=NGEHOFVBOCBBCYIVGSYLMKTFQWTDJ2EOGKYEW4X2OIWYH5TVGX2Q, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.825863449 (82h32m7.696946494s) [noise=true , address=89.149.201.147:4005 , piece_id=K6WGQSQZ32ZSAD6KN5IWB66MJ3YP76IKULPEHTFSODYFBSESSU4A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.866343990 (82h32m7.737427035s) [noise=true , address=89.149.201.147:4015 , piece_id=XBCH6ONGHITOZ2Z5GDPPKDV45TILCDFTOZ44OKMSZANCGVBGQ7ZQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.228780506 (82h32m8.099863541s) [noise=true , address=89.149.201.147:4017 , piece_id=5W66LIGVHUXIA4AVNKUNCOAJAP5TCYAKVFKCL6NDF2OVXNI62UMQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.230729618 (82h32m8.101812653s) [noise=true , address=89.149.201.147:4019 , piece_id=JTQ44O6RFCMIPK7LAEWXO2NTXAZAJK7XR3XAJGVQXLOLM7SFSBCA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.257428165 (82h32m8.12851121s) [noise=true , address=89.149.201.147:4020 , piece_id=T5RN3NMY35NXWM55YN3F7TWPPP7KXEER5R63W4KZV6Y2UNORJX4A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.267970901 (82h32m8.139053946s) [noise=true , address=89.149.201.147:4006 , piece_id=M3VDXP334RID2FJK7ZYNUHJBRMS57EXIMVMLER25MVJWM4EHJ2WA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.267990939 (82h32m8.139073974s) [seg_pos={0 0}, upload=72112]: Segment reached optimal threshold of 26 pieces.
Dec 9 02:01:08.268172084 (82h32m8.139255129s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF
Dec 9 02:01:08.268182163 (82h32m8.139265198s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Long tail cancellation due to optimal threshold
Dec 9 02:01:08.268290639 (82h32m8.139373684s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Dec 9 02:01:08.268299597 (82h32m8.139382642s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Long tail cancellation due to optimal threshold
Dec 9 02:01:08.268340294 (82h32m8.139423329s) [seg_pos={0 0}, upload=72112]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 9 02:01:08.268435756 (82h32m8.139518802s) [upload=72112]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 9 02:01:08.268441557 (82h32m8.139524592s) [upload=72112]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 9 02:12:41.424380970 (82h43m41.295464025s) [upload=72112]: Done uploading segments...
Dec 9 02:12:41.424504095 (82h43m41.29558713s) [upload=72112]: Upload finished. err: metaclient: context deadline exceeded
Duration: 12.087420612s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.....................................X.X.....X..............] duration:
5.727630407s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:14:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.727656587s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X......X......] duration:
473.463623ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/4e3d2b60e3f4041b
FAIL (2025-12-09 02:14:34 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 473.50457ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.781214s trace:
https://jaeger.dev.storj.io/trace/6f1ff10066b1d8ea
FAIL (2025-12-09 02:14:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
rue , address=185.167.204.206:4052 , piece_id=WY7PGT7EC5IUBTSHFEAMHXONCIKPFPRF3Y4YSL2IJNY2MOO6U7HA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.223188835 (82h32m5.09427188s) [noise=true , address=89.149.201.147:4011 , piece_id=I77RBTAA7KPTBE27RPPPCNYU65WBBUORVCNYAJOV5OHOBGUFEJKA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.223808365 (82h32m5.09489141s) [noise=true , address=185.167.204.206:4050 , piece_id=YKLEM6U44VR3GM45KKKJF7JYOFA4YQE6P5UAZZEMXIA2LBZW5UKA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.224324407 (82h32m5.095407452s) [noise=true , address=185.167.204.205:4011 , piece_id=6JR2JQYKTRLCSBJDUWWSJ6CRYGWKWN3AW3KJCPXMYLYPUN6W2DRQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.224877841 (82h32m5.095960886s) [noise=true , address=81.171.14.70:4032 , piece_id=APFBMO7KRDDWH6WT3H4ZLCXBAAMZTZQYQBN3XX6JZDGOBAMSGVCA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.225476030 (82h32m5.096559075s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.226119545 (82h32m5.09720258s) [noise=true , address=89.149.201.147:4015 , piece_id=XBCH6ONGHITOZ2Z5GDPPKDV45TILCDFTOZ44OKMSZANCGVBGQ7ZQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.226816121 (82h32m5.097899166s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.227549758 (82h32m5.098632813s) [noise=true , address=185.167.204.206:4067 , piece_id=PK6GGQNT4DQ2ZMF2IEEO5X32IMA26ULKDN7HAAG4CWOC2UAUKMMA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.228376403 (82h32m5.099459448s) [noise=true , address=81.171.14.70:4046 , piece_id=RR4RRWZ6YO3EK62O7TE2QUC3ZJ762VGUTVXVVHPGMQRPWEFTB7VA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.228990242 (82h32m5.100073297s) [noise=true , address=185.167.204.205:4013 , piece_id=7TBB5J7PYW23YFBOESEZ5Q6YOD3FKALVJMUQRMC5JSQ5JYKGDQSA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:06.054905806 (82h32m5.925988851s) [upload=72112]: Next returned nil segment
Dec 9 02:01:06.054930403 (82h32m5.926013448s) [upload=72112]: Waiting for error group managing segments...
Dec 9 02:01:06.441184862 (82h32m6.312267897s) [noise=true , address=185.167.204.205:4004 , piece_id=6CC2A4V4TJPRJBN4IMJ7VGDVFYTJIVY6J3ZIPZWYL5TIBLGT744A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.444455871 (82h32m6.315538916s) [noise=true , address=185.167.204.205:4005 , piece_id=QUO2YNK2MJJ63CKWADK5K64GYKHDOSBPFHKYKQSKH2TJQUZTNEVA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.447822552 (82h32m6.318905597s) [noise=true , address=185.167.204.206:4066 , piece_id=SSGUSCBUP2YNFN7OMUZQIXJJMSHV6GDHQYMN475LJFQQ7SV2FV2A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.451954059 (82h32m6.323037104s) [noise=true , address=185.167.204.205:4008 , piece_id=54IT2P63UNQKCHG4HB7CX7UWJFWDLJXXPOGPNAEN36ZAC4UQ6VQQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.454212810 (82h32m6.325295856s) [noise=true , address=185.167.204.205:4011 , piece_id=6JR2JQYKTRLCSBJDUWWSJ6CRYGWKWN3AW3KJCPXMYLYPUN6W2DRQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.454331416 (82h32m6.325414461s) [noise=true , address=185.167.204.206:4052 , piece_id=WY7PGT7EC5IUBTSHFEAMHXONCIKPFPRF3Y4YSL2IJNY2MOO6U7HA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.455138002 (82h32m6.326221047s) [noise=true , address=185.167.204.206:4050 , piece_id=YKLEM6U44VR3GM45KKKJF7JYOFA4YQE6P5UAZZEMXIA2LBZW5UKA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.459504045 (82h32m6.33058709s) [noise=true , address=185.167.204.205:4013 , piece_id=7TBB5J7PYW23YFBOESEZ5Q6YOD3FKALVJMUQRMC5JSQ5JYKGDQSA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.465474574 (82h32m6.336557629s) [noise=true , address=185.167.204.206:4067 , piece_id=PK6GGQNT4DQ2ZMF2IEEO5X32IMA26ULKDN7HAAG4CWOC2UAUKMMA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.060075359 (82h32m6.931158404s) [noise=true , address=81.171.14.70:4034 , piece_id=DNHPDP5YCQLS5AN6OHWRWVOGOIGE53YB7CJVUHNPJK35AEM455GQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.111399558 (82h32m6.982482603s) [noise=true , address=81.171.14.70:4026 , piece_id=CRRJW4OCPQUSWT6BERGQJPYYQ4DHSZIBMIBCD22QWCGGHUISCFXQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.133611052 (82h32m7.004694097s) [noise=true , address=81.171.14.70:4032 , piece_id=APFBMO7KRDDWH6WT3H4ZLCXBAAMZTZQYQBN3XX6JZDGOBAMSGVCA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.149778297 (82h32m7.020861342s) [noise=true , address=81.171.14.70:4030 , piece_id=VOYOWF6Y5DZOJ6DLW6QFYUI6DF5YA7FI4VI57LHMNCZ2PZLRY4BQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.243693687 (82h32m7.114776732s) [noise=true , address=81.171.14.70:4040 , piece_id=RYDZ6DCJ3Z5YKJPIFMLR7EHPH55S7HABKAJCKGRGHF2TCRKEYHXQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.624315751 (82h32m7.495398796s) [noise=true , address=81.171.14.70:4046 , piece_id=RR4RRWZ6YO3EK62O7TE2QUC3ZJ762VGUTVXVVHPGMQRPWEFTB7VA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.682160867 (82h32m7.553243912s) [noise=true , address=89.149.201.147:4011 , piece_id=I77RBTAA7KPTBE27RPPPCNYU65WBBUORVCNYAJOV5OHOBGUFEJKA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.704962114 (82h32m7.576045159s) [noise=true , address=89.149.201.147:4003 , piece_id=KQDYYB3S7PMHBAZTSQDATYYBAUYHMHEQDI6PW4GM4HKXBK4XHIVQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.723657624 (82h32m7.594740669s) [noise=true , address=89.149.201.147:4008 , piece_id=JCJNV47ZC7LJPXSERGUXP2QRLHVPOAQNOPI25RQZTA52IYKRZK4Q, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.729409366 (82h32m7.600492411s) [noise=true , address=89.149.201.147:4002 , piece_id=YFUKN6FRXESUYMS6ZV53MCQTZV5UXYHFF72WS2XJWGF3K3I72GTQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.761878943 (82h32m7.632961988s) [noise=true , address=89.149.201.147:4004 , piece_id=NGEHOFVBOCBBCYIVGSYLMKTFQWTDJ2EOGKYEW4X2OIWYH5TVGX2Q, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.825863449 (82h32m7.696946494s) [noise=true , address=89.149.201.147:4005 , piece_id=K6WGQSQZ32ZSAD6KN5IWB66MJ3YP76IKULPEHTFSODYFBSESSU4A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.866343990 (82h32m7.737427035s) [noise=true , address=89.149.201.147:4015 , piece_id=XBCH6ONGHITOZ2Z5GDPPKDV45TILCDFTOZ44OKMSZANCGVBGQ7ZQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.228780506 (82h32m8.099863541s) [noise=true , address=89.149.201.147:4017 , piece_id=5W66LIGVHUXIA4AVNKUNCOAJAP5TCYAKVFKCL6NDF2OVXNI62UMQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.230729618 (82h32m8.101812653s) [noise=true , address=89.149.201.147:4019 , piece_id=JTQ44O6RFCMIPK7LAEWXO2NTXAZAJK7XR3XAJGVQXLOLM7SFSBCA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.257428165 (82h32m8.12851121s) [noise=true , address=89.149.201.147:4020 , piece_id=T5RN3NMY35NXWM55YN3F7TWPPP7KXEER5R63W4KZV6Y2UNORJX4A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.267970901 (82h32m8.139053946s) [noise=true , address=89.149.201.147:4006 , piece_id=M3VDXP334RID2FJK7ZYNUHJBRMS57EXIMVMLER25MVJWM4EHJ2WA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.267990939 (82h32m8.139073974s) [seg_pos={0 0}, upload=72112]: Segment reached optimal threshold of 26 pieces.
Dec 9 02:01:08.268172084 (82h32m8.139255129s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF
Dec 9 02:01:08.268182163 (82h32m8.139265198s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Long tail cancellation due to optimal threshold
Dec 9 02:01:08.268290639 (82h32m8.139373684s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Dec 9 02:01:08.268299597 (82h32m8.139382642s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Long tail cancellation due to optimal threshold
Dec 9 02:01:08.268340294 (82h32m8.139423329s) [seg_pos={0 0}, upload=72112]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 9 02:01:08.268435756 (82h32m8.139518802s) [upload=72112]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 9 02:01:08.268441557 (82h32m8.139524592s) [upload=72112]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 9 02:12:41.424380970 (82h43m41.295464025s) [upload=72112]: Done uploading segments...
Dec 9 02:12:41.424504095 (82h43m41.29558713s) [upload=72112]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.781423339s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.821478358s trace:
https://jaeger.dev.storj.io/trace/40019ff87d088ff7
FAIL (2025-12-09 02:13:59 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.821514476s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [...............X.............X.......XX........X............] duration:
3.574651143s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:13:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.574676572s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [......................................X.X.....X.............] duration:
5.572173291s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:13:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.572213437s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
6.305515084s trace:
https://jaeger.dev.storj.io/trace/6f1ff10066b1d8ea
FAIL (2025-12-09 02:13:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
rue , address=185.167.204.206:4052 , piece_id=WY7PGT7EC5IUBTSHFEAMHXONCIKPFPRF3Y4YSL2IJNY2MOO6U7HA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.223188835 (82h32m5.09427188s) [noise=true , address=89.149.201.147:4011 , piece_id=I77RBTAA7KPTBE27RPPPCNYU65WBBUORVCNYAJOV5OHOBGUFEJKA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.223808365 (82h32m5.09489141s) [noise=true , address=185.167.204.206:4050 , piece_id=YKLEM6U44VR3GM45KKKJF7JYOFA4YQE6P5UAZZEMXIA2LBZW5UKA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.224324407 (82h32m5.095407452s) [noise=true , address=185.167.204.205:4011 , piece_id=6JR2JQYKTRLCSBJDUWWSJ6CRYGWKWN3AW3KJCPXMYLYPUN6W2DRQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.224877841 (82h32m5.095960886s) [noise=true , address=81.171.14.70:4032 , piece_id=APFBMO7KRDDWH6WT3H4ZLCXBAAMZTZQYQBN3XX6JZDGOBAMSGVCA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.225476030 (82h32m5.096559075s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.226119545 (82h32m5.09720258s) [noise=true , address=89.149.201.147:4015 , piece_id=XBCH6ONGHITOZ2Z5GDPPKDV45TILCDFTOZ44OKMSZANCGVBGQ7ZQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.226816121 (82h32m5.097899166s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.227549758 (82h32m5.098632813s) [noise=true , address=185.167.204.206:4067 , piece_id=PK6GGQNT4DQ2ZMF2IEEO5X32IMA26ULKDN7HAAG4CWOC2UAUKMMA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.228376403 (82h32m5.099459448s) [noise=true , address=81.171.14.70:4046 , piece_id=RR4RRWZ6YO3EK62O7TE2QUC3ZJ762VGUTVXVVHPGMQRPWEFTB7VA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.228990242 (82h32m5.100073297s) [noise=true , address=185.167.204.205:4013 , piece_id=7TBB5J7PYW23YFBOESEZ5Q6YOD3FKALVJMUQRMC5JSQ5JYKGDQSA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:06.054905806 (82h32m5.925988851s) [upload=72112]: Next returned nil segment
Dec 9 02:01:06.054930403 (82h32m5.926013448s) [upload=72112]: Waiting for error group managing segments...
Dec 9 02:01:06.441184862 (82h32m6.312267897s) [noise=true , address=185.167.204.205:4004 , piece_id=6CC2A4V4TJPRJBN4IMJ7VGDVFYTJIVY6J3ZIPZWYL5TIBLGT744A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.444455871 (82h32m6.315538916s) [noise=true , address=185.167.204.205:4005 , piece_id=QUO2YNK2MJJ63CKWADK5K64GYKHDOSBPFHKYKQSKH2TJQUZTNEVA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.447822552 (82h32m6.318905597s) [noise=true , address=185.167.204.206:4066 , piece_id=SSGUSCBUP2YNFN7OMUZQIXJJMSHV6GDHQYMN475LJFQQ7SV2FV2A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.451954059 (82h32m6.323037104s) [noise=true , address=185.167.204.205:4008 , piece_id=54IT2P63UNQKCHG4HB7CX7UWJFWDLJXXPOGPNAEN36ZAC4UQ6VQQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.454212810 (82h32m6.325295856s) [noise=true , address=185.167.204.205:4011 , piece_id=6JR2JQYKTRLCSBJDUWWSJ6CRYGWKWN3AW3KJCPXMYLYPUN6W2DRQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.454331416 (82h32m6.325414461s) [noise=true , address=185.167.204.206:4052 , piece_id=WY7PGT7EC5IUBTSHFEAMHXONCIKPFPRF3Y4YSL2IJNY2MOO6U7HA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.455138002 (82h32m6.326221047s) [noise=true , address=185.167.204.206:4050 , piece_id=YKLEM6U44VR3GM45KKKJF7JYOFA4YQE6P5UAZZEMXIA2LBZW5UKA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.459504045 (82h32m6.33058709s) [noise=true , address=185.167.204.205:4013 , piece_id=7TBB5J7PYW23YFBOESEZ5Q6YOD3FKALVJMUQRMC5JSQ5JYKGDQSA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.465474574 (82h32m6.336557629s) [noise=true , address=185.167.204.206:4067 , piece_id=PK6GGQNT4DQ2ZMF2IEEO5X32IMA26ULKDN7HAAG4CWOC2UAUKMMA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.060075359 (82h32m6.931158404s) [noise=true , address=81.171.14.70:4034 , piece_id=DNHPDP5YCQLS5AN6OHWRWVOGOIGE53YB7CJVUHNPJK35AEM455GQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.111399558 (82h32m6.982482603s) [noise=true , address=81.171.14.70:4026 , piece_id=CRRJW4OCPQUSWT6BERGQJPYYQ4DHSZIBMIBCD22QWCGGHUISCFXQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.133611052 (82h32m7.004694097s) [noise=true , address=81.171.14.70:4032 , piece_id=APFBMO7KRDDWH6WT3H4ZLCXBAAMZTZQYQBN3XX6JZDGOBAMSGVCA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.149778297 (82h32m7.020861342s) [noise=true , address=81.171.14.70:4030 , piece_id=VOYOWF6Y5DZOJ6DLW6QFYUI6DF5YA7FI4VI57LHMNCZ2PZLRY4BQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.243693687 (82h32m7.114776732s) [noise=true , address=81.171.14.70:4040 , piece_id=RYDZ6DCJ3Z5YKJPIFMLR7EHPH55S7HABKAJCKGRGHF2TCRKEYHXQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.624315751 (82h32m7.495398796s) [noise=true , address=81.171.14.70:4046 , piece_id=RR4RRWZ6YO3EK62O7TE2QUC3ZJ762VGUTVXVVHPGMQRPWEFTB7VA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.682160867 (82h32m7.553243912s) [noise=true , address=89.149.201.147:4011 , piece_id=I77RBTAA7KPTBE27RPPPCNYU65WBBUORVCNYAJOV5OHOBGUFEJKA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.704962114 (82h32m7.576045159s) [noise=true , address=89.149.201.147:4003 , piece_id=KQDYYB3S7PMHBAZTSQDATYYBAUYHMHEQDI6PW4GM4HKXBK4XHIVQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.723657624 (82h32m7.594740669s) [noise=true , address=89.149.201.147:4008 , piece_id=JCJNV47ZC7LJPXSERGUXP2QRLHVPOAQNOPI25RQZTA52IYKRZK4Q, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.729409366 (82h32m7.600492411s) [noise=true , address=89.149.201.147:4002 , piece_id=YFUKN6FRXESUYMS6ZV53MCQTZV5UXYHFF72WS2XJWGF3K3I72GTQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.761878943 (82h32m7.632961988s) [noise=true , address=89.149.201.147:4004 , piece_id=NGEHOFVBOCBBCYIVGSYLMKTFQWTDJ2EOGKYEW4X2OIWYH5TVGX2Q, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.825863449 (82h32m7.696946494s) [noise=true , address=89.149.201.147:4005 , piece_id=K6WGQSQZ32ZSAD6KN5IWB66MJ3YP76IKULPEHTFSODYFBSESSU4A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.866343990 (82h32m7.737427035s) [noise=true , address=89.149.201.147:4015 , piece_id=XBCH6ONGHITOZ2Z5GDPPKDV45TILCDFTOZ44OKMSZANCGVBGQ7ZQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.228780506 (82h32m8.099863541s) [noise=true , address=89.149.201.147:4017 , piece_id=5W66LIGVHUXIA4AVNKUNCOAJAP5TCYAKVFKCL6NDF2OVXNI62UMQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.230729618 (82h32m8.101812653s) [noise=true , address=89.149.201.147:4019 , piece_id=JTQ44O6RFCMIPK7LAEWXO2NTXAZAJK7XR3XAJGVQXLOLM7SFSBCA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.257428165 (82h32m8.12851121s) [noise=true , address=89.149.201.147:4020 , piece_id=T5RN3NMY35NXWM55YN3F7TWPPP7KXEER5R63W4KZV6Y2UNORJX4A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.267970901 (82h32m8.139053946s) [noise=true , address=89.149.201.147:4006 , piece_id=M3VDXP334RID2FJK7ZYNUHJBRMS57EXIMVMLER25MVJWM4EHJ2WA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.267990939 (82h32m8.139073974s) [seg_pos={0 0}, upload=72112]: Segment reached optimal threshold of 26 pieces.
Dec 9 02:01:08.268172084 (82h32m8.139255129s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF
Dec 9 02:01:08.268182163 (82h32m8.139265198s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Long tail cancellation due to optimal threshold
Dec 9 02:01:08.268290639 (82h32m8.139373684s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Dec 9 02:01:08.268299597 (82h32m8.139382642s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Long tail cancellation due to optimal threshold
Dec 9 02:01:08.268340294 (82h32m8.139423329s) [seg_pos={0 0}, upload=72112]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 9 02:01:08.268435756 (82h32m8.139518802s) [upload=72112]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 9 02:01:08.268441557 (82h32m8.139524592s) [upload=72112]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 9 02:12:41.424380970 (82h43m41.295464025s) [upload=72112]: Done uploading segments...
Dec 9 02:12:41.424504095 (82h43m41.29558713s) [upload=72112]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.305546914s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X......X.....] duration:
478.018533ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/4e3d2b60e3f4041b
FAIL (2025-12-09 02:13:32 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 478.048741ms
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [................X.............X.......XX........X...........] duration:
3.362476055s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:13:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.362506875s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.......................................X.X.....X............] duration:
5.570165228s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:13:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.570198s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
6.154130621s trace:
https://jaeger.dev.storj.io/trace/40019ff87d088ff7
FAIL (2025-12-09 02:13:06 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.154151591s
core
uplink
us1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [................................................X......X....] duration:
477.813312ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/4e3d2b60e3f4041b
FAIL (2025-12-09 02:13:04 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 477.843239ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
6.681603867s trace:
https://jaeger.dev.storj.io/trace/6f1ff10066b1d8ea
FAIL (2025-12-09 02:12:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
rue , address=185.167.204.206:4052 , piece_id=WY7PGT7EC5IUBTSHFEAMHXONCIKPFPRF3Y4YSL2IJNY2MOO6U7HA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.223188835 (82h32m5.09427188s) [noise=true , address=89.149.201.147:4011 , piece_id=I77RBTAA7KPTBE27RPPPCNYU65WBBUORVCNYAJOV5OHOBGUFEJKA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.223808365 (82h32m5.09489141s) [noise=true , address=185.167.204.206:4050 , piece_id=YKLEM6U44VR3GM45KKKJF7JYOFA4YQE6P5UAZZEMXIA2LBZW5UKA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.224324407 (82h32m5.095407452s) [noise=true , address=185.167.204.205:4011 , piece_id=6JR2JQYKTRLCSBJDUWWSJ6CRYGWKWN3AW3KJCPXMYLYPUN6W2DRQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.224877841 (82h32m5.095960886s) [noise=true , address=81.171.14.70:4032 , piece_id=APFBMO7KRDDWH6WT3H4ZLCXBAAMZTZQYQBN3XX6JZDGOBAMSGVCA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.225476030 (82h32m5.096559075s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.226119545 (82h32m5.09720258s) [noise=true , address=89.149.201.147:4015 , piece_id=XBCH6ONGHITOZ2Z5GDPPKDV45TILCDFTOZ44OKMSZANCGVBGQ7ZQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.226816121 (82h32m5.097899166s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.227549758 (82h32m5.098632813s) [noise=true , address=185.167.204.206:4067 , piece_id=PK6GGQNT4DQ2ZMF2IEEO5X32IMA26ULKDN7HAAG4CWOC2UAUKMMA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.228376403 (82h32m5.099459448s) [noise=true , address=81.171.14.70:4046 , piece_id=RR4RRWZ6YO3EK62O7TE2QUC3ZJ762VGUTVXVVHPGMQRPWEFTB7VA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.228990242 (82h32m5.100073297s) [noise=true , address=185.167.204.205:4013 , piece_id=7TBB5J7PYW23YFBOESEZ5Q6YOD3FKALVJMUQRMC5JSQ5JYKGDQSA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:06.054905806 (82h32m5.925988851s) [upload=72112]: Next returned nil segment
Dec 9 02:01:06.054930403 (82h32m5.926013448s) [upload=72112]: Waiting for error group managing segments...
Dec 9 02:01:06.441184862 (82h32m6.312267897s) [noise=true , address=185.167.204.205:4004 , piece_id=6CC2A4V4TJPRJBN4IMJ7VGDVFYTJIVY6J3ZIPZWYL5TIBLGT744A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.444455871 (82h32m6.315538916s) [noise=true , address=185.167.204.205:4005 , piece_id=QUO2YNK2MJJ63CKWADK5K64GYKHDOSBPFHKYKQSKH2TJQUZTNEVA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.447822552 (82h32m6.318905597s) [noise=true , address=185.167.204.206:4066 , piece_id=SSGUSCBUP2YNFN7OMUZQIXJJMSHV6GDHQYMN475LJFQQ7SV2FV2A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.451954059 (82h32m6.323037104s) [noise=true , address=185.167.204.205:4008 , piece_id=54IT2P63UNQKCHG4HB7CX7UWJFWDLJXXPOGPNAEN36ZAC4UQ6VQQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.454212810 (82h32m6.325295856s) [noise=true , address=185.167.204.205:4011 , piece_id=6JR2JQYKTRLCSBJDUWWSJ6CRYGWKWN3AW3KJCPXMYLYPUN6W2DRQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.454331416 (82h32m6.325414461s) [noise=true , address=185.167.204.206:4052 , piece_id=WY7PGT7EC5IUBTSHFEAMHXONCIKPFPRF3Y4YSL2IJNY2MOO6U7HA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.455138002 (82h32m6.326221047s) [noise=true , address=185.167.204.206:4050 , piece_id=YKLEM6U44VR3GM45KKKJF7JYOFA4YQE6P5UAZZEMXIA2LBZW5UKA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.459504045 (82h32m6.33058709s) [noise=true , address=185.167.204.205:4013 , piece_id=7TBB5J7PYW23YFBOESEZ5Q6YOD3FKALVJMUQRMC5JSQ5JYKGDQSA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.465474574 (82h32m6.336557629s) [noise=true , address=185.167.204.206:4067 , piece_id=PK6GGQNT4DQ2ZMF2IEEO5X32IMA26ULKDN7HAAG4CWOC2UAUKMMA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.060075359 (82h32m6.931158404s) [noise=true , address=81.171.14.70:4034 , piece_id=DNHPDP5YCQLS5AN6OHWRWVOGOIGE53YB7CJVUHNPJK35AEM455GQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.111399558 (82h32m6.982482603s) [noise=true , address=81.171.14.70:4026 , piece_id=CRRJW4OCPQUSWT6BERGQJPYYQ4DHSZIBMIBCD22QWCGGHUISCFXQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.133611052 (82h32m7.004694097s) [noise=true , address=81.171.14.70:4032 , piece_id=APFBMO7KRDDWH6WT3H4ZLCXBAAMZTZQYQBN3XX6JZDGOBAMSGVCA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.149778297 (82h32m7.020861342s) [noise=true , address=81.171.14.70:4030 , piece_id=VOYOWF6Y5DZOJ6DLW6QFYUI6DF5YA7FI4VI57LHMNCZ2PZLRY4BQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.243693687 (82h32m7.114776732s) [noise=true , address=81.171.14.70:4040 , piece_id=RYDZ6DCJ3Z5YKJPIFMLR7EHPH55S7HABKAJCKGRGHF2TCRKEYHXQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.624315751 (82h32m7.495398796s) [noise=true , address=81.171.14.70:4046 , piece_id=RR4RRWZ6YO3EK62O7TE2QUC3ZJ762VGUTVXVVHPGMQRPWEFTB7VA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.682160867 (82h32m7.553243912s) [noise=true , address=89.149.201.147:4011 , piece_id=I77RBTAA7KPTBE27RPPPCNYU65WBBUORVCNYAJOV5OHOBGUFEJKA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.704962114 (82h32m7.576045159s) [noise=true , address=89.149.201.147:4003 , piece_id=KQDYYB3S7PMHBAZTSQDATYYBAUYHMHEQDI6PW4GM4HKXBK4XHIVQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.723657624 (82h32m7.594740669s) [noise=true , address=89.149.201.147:4008 , piece_id=JCJNV47ZC7LJPXSERGUXP2QRLHVPOAQNOPI25RQZTA52IYKRZK4Q, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.729409366 (82h32m7.600492411s) [noise=true , address=89.149.201.147:4002 , piece_id=YFUKN6FRXESUYMS6ZV53MCQTZV5UXYHFF72WS2XJWGF3K3I72GTQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.761878943 (82h32m7.632961988s) [noise=true , address=89.149.201.147:4004 , piece_id=NGEHOFVBOCBBCYIVGSYLMKTFQWTDJ2EOGKYEW4X2OIWYH5TVGX2Q, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.825863449 (82h32m7.696946494s) [noise=true , address=89.149.201.147:4005 , piece_id=K6WGQSQZ32ZSAD6KN5IWB66MJ3YP76IKULPEHTFSODYFBSESSU4A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.866343990 (82h32m7.737427035s) [noise=true , address=89.149.201.147:4015 , piece_id=XBCH6ONGHITOZ2Z5GDPPKDV45TILCDFTOZ44OKMSZANCGVBGQ7ZQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.228780506 (82h32m8.099863541s) [noise=true , address=89.149.201.147:4017 , piece_id=5W66LIGVHUXIA4AVNKUNCOAJAP5TCYAKVFKCL6NDF2OVXNI62UMQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.230729618 (82h32m8.101812653s) [noise=true , address=89.149.201.147:4019 , piece_id=JTQ44O6RFCMIPK7LAEWXO2NTXAZAJK7XR3XAJGVQXLOLM7SFSBCA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.257428165 (82h32m8.12851121s) [noise=true , address=89.149.201.147:4020 , piece_id=T5RN3NMY35NXWM55YN3F7TWPPP7KXEER5R63W4KZV6Y2UNORJX4A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.267970901 (82h32m8.139053946s) [noise=true , address=89.149.201.147:4006 , piece_id=M3VDXP334RID2FJK7ZYNUHJBRMS57EXIMVMLER25MVJWM4EHJ2WA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.267990939 (82h32m8.139073974s) [seg_pos={0 0}, upload=72112]: Segment reached optimal threshold of 26 pieces.
Dec 9 02:01:08.268172084 (82h32m8.139255129s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF
Dec 9 02:01:08.268182163 (82h32m8.139265198s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Long tail cancellation due to optimal threshold
Dec 9 02:01:08.268290639 (82h32m8.139373684s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Dec 9 02:01:08.268299597 (82h32m8.139382642s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Long tail cancellation due to optimal threshold
Dec 9 02:01:08.268340294 (82h32m8.139423329s) [seg_pos={0 0}, upload=72112]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 9 02:01:08.268435756 (82h32m8.139518802s) [upload=72112]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 9 02:01:08.268441557 (82h32m8.139524592s) [upload=72112]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 9 02:12:41.424380970 (82h43m41.295464025s) [upload=72112]: Done uploading segments...
Dec 9 02:12:41.424504095 (82h43m41.29558713s) [upload=72112]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.681620448s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
11m41.120709694s trace:
https://jaeger.dev.storj.io/trace/6f1ff10066b1d8ea
FAIL (2025-12-09 02:12:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
rue , address=185.167.204.206:4052 , piece_id=WY7PGT7EC5IUBTSHFEAMHXONCIKPFPRF3Y4YSL2IJNY2MOO6U7HA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.223188835 (82h32m5.09427188s) [noise=true , address=89.149.201.147:4011 , piece_id=I77RBTAA7KPTBE27RPPPCNYU65WBBUORVCNYAJOV5OHOBGUFEJKA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.223808365 (82h32m5.09489141s) [noise=true , address=185.167.204.206:4050 , piece_id=YKLEM6U44VR3GM45KKKJF7JYOFA4YQE6P5UAZZEMXIA2LBZW5UKA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.224324407 (82h32m5.095407452s) [noise=true , address=185.167.204.205:4011 , piece_id=6JR2JQYKTRLCSBJDUWWSJ6CRYGWKWN3AW3KJCPXMYLYPUN6W2DRQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.224877841 (82h32m5.095960886s) [noise=true , address=81.171.14.70:4032 , piece_id=APFBMO7KRDDWH6WT3H4ZLCXBAAMZTZQYQBN3XX6JZDGOBAMSGVCA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.225476030 (82h32m5.096559075s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.226119545 (82h32m5.09720258s) [noise=true , address=89.149.201.147:4015 , piece_id=XBCH6ONGHITOZ2Z5GDPPKDV45TILCDFTOZ44OKMSZANCGVBGQ7ZQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.226816121 (82h32m5.097899166s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.227549758 (82h32m5.098632813s) [noise=true , address=185.167.204.206:4067 , piece_id=PK6GGQNT4DQ2ZMF2IEEO5X32IMA26ULKDN7HAAG4CWOC2UAUKMMA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.228376403 (82h32m5.099459448s) [noise=true , address=81.171.14.70:4046 , piece_id=RR4RRWZ6YO3EK62O7TE2QUC3ZJ762VGUTVXVVHPGMQRPWEFTB7VA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:05.228990242 (82h32m5.100073297s) [noise=true , address=185.167.204.205:4013 , piece_id=7TBB5J7PYW23YFBOESEZ5Q6YOD3FKALVJMUQRMC5JSQ5JYKGDQSA, seg_pos={0 0}, upload=72112]: Uploading piece...
Dec 9 02:01:06.054905806 (82h32m5.925988851s) [upload=72112]: Next returned nil segment
Dec 9 02:01:06.054930403 (82h32m5.926013448s) [upload=72112]: Waiting for error group managing segments...
Dec 9 02:01:06.441184862 (82h32m6.312267897s) [noise=true , address=185.167.204.205:4004 , piece_id=6CC2A4V4TJPRJBN4IMJ7VGDVFYTJIVY6J3ZIPZWYL5TIBLGT744A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.444455871 (82h32m6.315538916s) [noise=true , address=185.167.204.205:4005 , piece_id=QUO2YNK2MJJ63CKWADK5K64GYKHDOSBPFHKYKQSKH2TJQUZTNEVA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.447822552 (82h32m6.318905597s) [noise=true , address=185.167.204.206:4066 , piece_id=SSGUSCBUP2YNFN7OMUZQIXJJMSHV6GDHQYMN475LJFQQ7SV2FV2A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.451954059 (82h32m6.323037104s) [noise=true , address=185.167.204.205:4008 , piece_id=54IT2P63UNQKCHG4HB7CX7UWJFWDLJXXPOGPNAEN36ZAC4UQ6VQQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.454212810 (82h32m6.325295856s) [noise=true , address=185.167.204.205:4011 , piece_id=6JR2JQYKTRLCSBJDUWWSJ6CRYGWKWN3AW3KJCPXMYLYPUN6W2DRQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.454331416 (82h32m6.325414461s) [noise=true , address=185.167.204.206:4052 , piece_id=WY7PGT7EC5IUBTSHFEAMHXONCIKPFPRF3Y4YSL2IJNY2MOO6U7HA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.455138002 (82h32m6.326221047s) [noise=true , address=185.167.204.206:4050 , piece_id=YKLEM6U44VR3GM45KKKJF7JYOFA4YQE6P5UAZZEMXIA2LBZW5UKA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.459504045 (82h32m6.33058709s) [noise=true , address=185.167.204.205:4013 , piece_id=7TBB5J7PYW23YFBOESEZ5Q6YOD3FKALVJMUQRMC5JSQ5JYKGDQSA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:06.465474574 (82h32m6.336557629s) [noise=true , address=185.167.204.206:4067 , piece_id=PK6GGQNT4DQ2ZMF2IEEO5X32IMA26ULKDN7HAAG4CWOC2UAUKMMA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.060075359 (82h32m6.931158404s) [noise=true , address=81.171.14.70:4034 , piece_id=DNHPDP5YCQLS5AN6OHWRWVOGOIGE53YB7CJVUHNPJK35AEM455GQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.111399558 (82h32m6.982482603s) [noise=true , address=81.171.14.70:4026 , piece_id=CRRJW4OCPQUSWT6BERGQJPYYQ4DHSZIBMIBCD22QWCGGHUISCFXQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.133611052 (82h32m7.004694097s) [noise=true , address=81.171.14.70:4032 , piece_id=APFBMO7KRDDWH6WT3H4ZLCXBAAMZTZQYQBN3XX6JZDGOBAMSGVCA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.149778297 (82h32m7.020861342s) [noise=true , address=81.171.14.70:4030 , piece_id=VOYOWF6Y5DZOJ6DLW6QFYUI6DF5YA7FI4VI57LHMNCZ2PZLRY4BQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.243693687 (82h32m7.114776732s) [noise=true , address=81.171.14.70:4040 , piece_id=RYDZ6DCJ3Z5YKJPIFMLR7EHPH55S7HABKAJCKGRGHF2TCRKEYHXQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.624315751 (82h32m7.495398796s) [noise=true , address=81.171.14.70:4046 , piece_id=RR4RRWZ6YO3EK62O7TE2QUC3ZJ762VGUTVXVVHPGMQRPWEFTB7VA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.682160867 (82h32m7.553243912s) [noise=true , address=89.149.201.147:4011 , piece_id=I77RBTAA7KPTBE27RPPPCNYU65WBBUORVCNYAJOV5OHOBGUFEJKA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.704962114 (82h32m7.576045159s) [noise=true , address=89.149.201.147:4003 , piece_id=KQDYYB3S7PMHBAZTSQDATYYBAUYHMHEQDI6PW4GM4HKXBK4XHIVQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.723657624 (82h32m7.594740669s) [noise=true , address=89.149.201.147:4008 , piece_id=JCJNV47ZC7LJPXSERGUXP2QRLHVPOAQNOPI25RQZTA52IYKRZK4Q, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.729409366 (82h32m7.600492411s) [noise=true , address=89.149.201.147:4002 , piece_id=YFUKN6FRXESUYMS6ZV53MCQTZV5UXYHFF72WS2XJWGF3K3I72GTQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.761878943 (82h32m7.632961988s) [noise=true , address=89.149.201.147:4004 , piece_id=NGEHOFVBOCBBCYIVGSYLMKTFQWTDJ2EOGKYEW4X2OIWYH5TVGX2Q, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.825863449 (82h32m7.696946494s) [noise=true , address=89.149.201.147:4005 , piece_id=K6WGQSQZ32ZSAD6KN5IWB66MJ3YP76IKULPEHTFSODYFBSESSU4A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:07.866343990 (82h32m7.737427035s) [noise=true , address=89.149.201.147:4015 , piece_id=XBCH6ONGHITOZ2Z5GDPPKDV45TILCDFTOZ44OKMSZANCGVBGQ7ZQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.228780506 (82h32m8.099863541s) [noise=true , address=89.149.201.147:4017 , piece_id=5W66LIGVHUXIA4AVNKUNCOAJAP5TCYAKVFKCL6NDF2OVXNI62UMQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.230729618 (82h32m8.101812653s) [noise=true , address=89.149.201.147:4019 , piece_id=JTQ44O6RFCMIPK7LAEWXO2NTXAZAJK7XR3XAJGVQXLOLM7SFSBCA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.257428165 (82h32m8.12851121s) [noise=true , address=89.149.201.147:4020 , piece_id=T5RN3NMY35NXWM55YN3F7TWPPP7KXEER5R63W4KZV6Y2UNORJX4A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.267970901 (82h32m8.139053946s) [noise=true , address=89.149.201.147:4006 , piece_id=M3VDXP334RID2FJK7ZYNUHJBRMS57EXIMVMLER25MVJWM4EHJ2WA, seg_pos={0 0}, upload=72112]: Done uploading piece. err: <nil>
Dec 9 02:01:08.267990939 (82h32m8.139073974s) [seg_pos={0 0}, upload=72112]: Segment reached optimal threshold of 26 pieces.
Dec 9 02:01:08.268172084 (82h32m8.139255129s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF
Dec 9 02:01:08.268182163 (82h32m8.139265198s) [noise=true , address=89.149.201.147:4012 , piece_id=7UFT32WUAW2JUETM2Y4SFGMSPTNLVVH5FKPQJSK6S3DR6E64ITKQ, seg_pos={0 0}, upload=72112]: Long tail cancellation due to optimal threshold
Dec 9 02:01:08.268290639 (82h32m8.139373684s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Dec 9 02:01:08.268299597 (82h32m8.139382642s) [noise=true , address=89.149.201.147:4014 , piece_id=PFXVAHNZ2Q6YC2MGNSUZMJIL5Q2O2HPDSONU3FD3E472H2G7AG5A, seg_pos={0 0}, upload=72112]: Long tail cancellation due to optimal threshold
Dec 9 02:01:08.268340294 (82h32m8.139423329s) [seg_pos={0 0}, upload=72112]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 9 02:01:08.268435756 (82h32m8.139518802s) [upload=72112]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 9 02:01:08.268441557 (82h32m8.139524592s) [upload=72112]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 9 02:12:41.424380970 (82h43m41.295464025s) [upload=72112]: Done uploading segments...
Dec 9 02:12:41.424504095 (82h43m41.29558713s) [upload=72112]: Upload finished. err: metaclient: context deadline exceeded
Duration: 11m41.120809536s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [.................X.............X.......XX........X..........] duration:
3.46572996s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:12:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.46578242s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [........................................X.X.....X...........] duration:
6.690156479s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:12:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.690186447s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X......X...] duration:
483.408587ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/4e3d2b60e3f4041b
FAIL (2025-12-09 02:12:02 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 483.438032ms
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.........................................X.X.....X..........] duration:
5.527124321s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:11:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.527160852s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
6.075961895s trace:
https://jaeger.dev.storj.io/trace/40019ff87d088ff7
FAIL (2025-12-09 02:11:52 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.075983427s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [..................X.............X.......XX........X.........] duration:
3.421736039s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:11:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.421762681s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.981406938s trace:
https://jaeger.dev.storj.io/trace/40019ff87d088ff7
FAIL (2025-12-09 02:11:29 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.981431946s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [...................X.............X.......XX........X........] duration:
3.441806086s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:11:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.441836806s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
4 out of 60 is failed (threshold=3) [X.........................................X.X.....X.........] duration:
5.71473839s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:11:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.714766304s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X......X..] duration:
466.18415ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/4e3d2b60e3f4041b
FAIL (2025-12-09 02:11:23 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 466.20623ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.955587213s trace:
https://jaeger.dev.storj.io/trace/40019ff87d088ff7
FAIL (2025-12-09 02:11:04 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.955619054s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.822663764s trace:
https://jaeger.dev.storj.io/trace/40019ff87d088ff7
FAIL (2025-12-09 02:10:38 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.822695826s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
4 out of 60 is failed (threshold=3) [.X.........................................X.X.....X........] duration:
5.792001548s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:10:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.792023851s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [....................X.............X.......XX........X.......] duration:
3.414512585s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:10:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.414555988s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X......X.] duration:
467.526674ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/4e3d2b60e3f4041b
FAIL (2025-12-09 02:10:21 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 467.542825ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X......X] duration:
1m0.308882571s remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/4e3d2b60e3f4041b
FAIL (2025-12-09 02:10:20 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 1m0.308909452s
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [X.X.........................................X.X.....X.......] duration:
6.185233349s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:10:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.185261833s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [.....................X.............X.......XX........X......] duration:
3.509859951s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:10:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.5099121s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.975912398s trace:
https://jaeger.dev.storj.io/trace/40019ff87d088ff7
FAIL (2025-12-09 02:09:58 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.97594031s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [......................X.............X.......XX........X.....] duration:
3.37512767s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:09:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.375150984s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.X.X.........................................X.X.....X......] duration:
5.78534665s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:09:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.785370534s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
470.253637ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/21b9ce8e459c22e7
FAIL (2025-12-09 02:08:54 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 470.293635ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
6.354568927s trace:
https://jaeger.dev.storj.io/trace/40019ff87d088ff7
FAIL (2025-12-09 02:08:51 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.354602762s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [.......................X.............X.......XX........X....] duration:
3.474825129s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:08:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.474855087s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [..X.X.........................................X.X.....X.....] duration:
5.946219404s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:08:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.946246405s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
479.914363ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/21b9ce8e459c22e7
FAIL (2025-12-09 02:08:06 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 479.942186ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
6.049710727s trace:
https://jaeger.dev.storj.io/trace/40019ff87d088ff7
FAIL (2025-12-09 02:08:01 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.049744271s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [........................X.............X.......XX........X...] duration:
3.546448271s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:07:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.546481525s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
6.021654657s trace:
https://jaeger.dev.storj.io/trace/40019ff87d088ff7
FAIL (2025-12-09 02:07:43 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.021687979s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [...X.X.........................................X.X.....X....] duration:
5.839609915s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:07:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.839634922s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
469.037341ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/21b9ce8e459c22e7
FAIL (2025-12-09 02:07:20 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 469.059775ms
core
satellite
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [.........................X.............X.......XX........X..] duration:
3.683249022s trace:
https://jaeger.dev.storj.io/trace/dbaa73a4151be2e
FAIL (2025-12-09 02:07:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.683273769s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.140409142s trace:
https://jaeger.dev.storj.io/trace/1b9ac1acdb153d00
FAIL (2025-12-09 02:06:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
A, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.018287744 (81h49m44.88937079s) [noise=true , address=45.91.116.10:4098 , piece_id=Q6MKNY37MMBVHUOMWJCTPE5BPXWG7G7RLEHQKLXYSDSI2KKYTPNQ, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.018979372 (81h49m44.890062467s) [noise=true , address=45.91.116.5:4306 , piece_id=5S4PWZULVPGCP4I4PSINBYKIOCBPLFIUOZE5QO4CKTQ3I7P76BQQ, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.019582951 (81h49m44.890666006s) [noise=true , address=77.90.31.10:4538 , piece_id=KTOSBWL7QVBHLWCAMOZNTHRCLWMUUHCLIPI2W52KOHNJ55NLNRWQ, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.019819150 (81h49m44.890902196s) [noise=true , address=77.90.31.10:4530 , piece_id=XVCYKZOJ2H3U5RWMWW3BIBW37YK3ZQUHNIJHSGGTP7R2X244Y55Q, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.020245322 (81h49m44.891328377s) [noise=true , address=45.91.116.9:4287 , piece_id=GUUNM5MV3J7OELO633ESY3EMGLJOZKXNUKT3SRI7GKYJDYIC6SPA, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.020660623 (81h49m44.891743658s) [noise=true , address=145.79.227.12:4769 , piece_id=YTUOFFOTJBPKJUKCRDIY6S65ZP3W5XJCW7GU6GLSFHDUOPOTQO4Q, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.021074250 (81h49m44.892157295s) [noise=true , address=77.90.31.11:4570 , piece_id=HIPMDO4ST4XFQDT3M7PFIIARDMPBX2WEIPRVHOQI4OEIPMJIZZRA, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.021462369 (81h49m44.892545414s) [noise=true , address=145.79.227.49:4359 , piece_id=FDOP6PX5XFB5OJVC7H4S6ZFY4FT5AAWOLIH43M4GTLCZS5YKIM5Q, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.021981778 (81h49m44.893064813s) [noise=true , address=145.79.227.52:4454 , piece_id=7YBPVY5EXGAIQKJEP5TCXX5KRFBUBC45QQI6CONCS5LGUMRU3Y4Q, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.022307669 (81h49m44.893390704s) [noise=true , address=145.79.227.9:4384 , piece_id=3JXASIXRKWJ573Q466LHQLNOZXF4UC2A6LRJKZE2KBOY2N444EUA, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.022633470 (81h49m44.893716505s) [noise=true , address=64.49.13.170:4722 , piece_id=Y5ZZFYYBICQCKHXREFINQ6LA6IUU4MAS4OA4SJXFBC2BFMIG4IMQ, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.023012681 (81h49m44.894095716s) [noise=true , address=77.90.31.16:4755 , piece_id=M2EBCSYLP54HIYVMV2WFXQRTLSISUJKZPGQRB6K6EEWSRKJKWVYA, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.023282415 (81h49m44.89436546s) [noise=true , address=145.79.227.4:4205 , piece_id=BWNYAT67IELSPLQTYMAM2O76OLQWUTXACQXR4VZSAQE67NYOASRA, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.023555585 (81h49m44.89463862s) [noise=true , address=77.90.31.16:4736 , piece_id=BHZSQ7MXD2X4YEGL6IYMUYCHURUXDRRRJDYPTBVZ44SORXMPSO5A, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.023817675 (81h49m44.89490071s) [noise=true , address=77.90.31.15:4713 , piece_id=BCW7S3OAKKGDYPH7RP7B6VJJSG5HNCR2DTLMHZDRLO4EEOPH7FKQ, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.024446281 (81h49m44.895529327s) [noise=true , address=77.90.31.17:4769 , piece_id=66IBD3RPUO7QFO4ALJSH5W4ELFKPLDOHSMIQ7UWNGGDV3OXZGUQQ, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:45.024703942 (81h49m44.895786987s) [noise=true , address=145.79.227.39:4037 , piece_id=PGBSSKDC7LGLKZE3FGX6FHAC6H45RMOLJFVQHCJPWWAVZSOSIG5A, seg_pos={0 0}, upload=71502]: Uploading piece...
Dec 9 01:18:46.437570978 (81h49m46.308654013s) [upload=71502]: Next returned nil segment
Dec 9 01:18:46.437586438 (81h49m46.308669483s) [upload=71502]: Waiting for error group managing segments...
Dec 9 01:18:46.796243098 (81h49m46.667326134s) [noise=true , address=64.49.13.170:4722 , piece_id=Y5ZZFYYBICQCKHXREFINQ6LA6IUU4MAS4OA4SJXFBC2BFMIG4IMQ, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:46.894539060 (81h49m46.765622105s) [noise=true , address=145.79.227.39:4037 , piece_id=PGBSSKDC7LGLKZE3FGX6FHAC6H45RMOLJFVQHCJPWWAVZSOSIG5A, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:46.906718262 (81h49m46.777801297s) [noise=true , address=145.79.227.9:4384 , piece_id=3JXASIXRKWJ573Q466LHQLNOZXF4UC2A6LRJKZE2KBOY2N444EUA, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:46.914490982 (81h49m46.785574027s) [noise=true , address=145.79.227.49:4359 , piece_id=FDOP6PX5XFB5OJVC7H4S6ZFY4FT5AAWOLIH43M4GTLCZS5YKIM5Q, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:46.928206178 (81h49m46.799289213s) [noise=true , address=145.79.227.52:4454 , piece_id=7YBPVY5EXGAIQKJEP5TCXX5KRFBUBC45QQI6CONCS5LGUMRU3Y4Q, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:46.953023966 (81h49m46.824107001s) [noise=true , address=145.79.227.12:4769 , piece_id=YTUOFFOTJBPKJUKCRDIY6S65ZP3W5XJCW7GU6GLSFHDUOPOTQO4Q, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:46.994863524 (81h49m46.865946569s) [noise=true , address=77.90.31.16:4755 , piece_id=M2EBCSYLP54HIYVMV2WFXQRTLSISUJKZPGQRB6K6EEWSRKJKWVYA, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:46.998843783 (81h49m46.869926818s) [noise=true , address=77.90.31.18:4830 , piece_id=3CTHRQHH7RNBOS6DDU3PUHE5TGEQMB4UBDSJEXE67GM7PXJIEO4A, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:47.002758567 (81h49m46.873841602s) [noise=true , address=77.90.31.17:4769 , piece_id=66IBD3RPUO7QFO4ALJSH5W4ELFKPLDOHSMIQ7UWNGGDV3OXZGUQQ, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:47.010756346 (81h49m46.881839382s) [noise=true , address=77.90.31.11:4570 , piece_id=HIPMDO4ST4XFQDT3M7PFIIARDMPBX2WEIPRVHOQI4OEIPMJIZZRA, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:47.088053593 (81h49m46.959136638s) [noise=true , address=45.91.116.10:4098 , piece_id=Q6MKNY37MMBVHUOMWJCTPE5BPXWG7G7RLEHQKLXYSDSI2KKYTPNQ, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:47.094063277 (81h49m46.965146322s) [noise=true , address=77.90.31.10:4530 , piece_id=XVCYKZOJ2H3U5RWMWW3BIBW37YK3ZQUHNIJHSGGTP7R2X244Y55Q, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:47.101953681 (81h49m46.973036726s) [noise=true , address=45.91.116.5:4306 , piece_id=5S4PWZULVPGCP4I4PSINBYKIOCBPLFIUOZE5QO4CKTQ3I7P76BQQ, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:47.109207003 (81h49m46.980290038s) [noise=true , address=77.90.31.10:4538 , piece_id=KTOSBWL7QVBHLWCAMOZNTHRCLWMUUHCLIPI2W52KOHNJ55NLNRWQ, seg_pos={0 0}, upload=71502]: Done uploading piece. err: <nil>
Dec 9 01:18:47.109225769 (81h49m46.980308804s) [seg_pos={0 0}, upload=71502]: Segment reached optimal threshold of 14 pieces.
Dec 9 01:18:47.109408547 (81h49m46.980491592s) [noise=true , address=77.90.31.15:4713 , piece_id=BCW7S3OAKKGDYPH7RP7B6VJJSG5HNCR2DTLMHZDRLO4EEOPH7FKQ, seg_pos={0 0}, upload=71502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Liv9RcEgfjxodPuadijzkcUGgJEy7LfKqHGFhaJCKbcxKkNN8): protocol: expected piece hash; context canceled; EOF
Dec 9 01:18:47.109416322 (81h49m46.980499357s) [noise=true , address=77.90.31.15:4713 , piece_id=BCW7S3OAKKGDYPH7RP7B6VJJSG5HNCR2DTLMHZDRLO4EEOPH7FKQ, seg_pos={0 0}, upload=71502]: Long tail cancellation due to optimal threshold
Dec 9 01:18:47.109443945 (81h49m46.98052698s) [noise=true , address=45.91.116.9:4287 , piece_id=GUUNM5MV3J7OELO633ESY3EMGLJOZKXNUKT3SRI7GKYJDYIC6SPA, seg_pos={0 0}, upload=71502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cNuooGmeprkK8fRRBY5ZSAbWda7fdfPbYwbg3fV2TKGsYikwf): protocol: expected piece hash; context canceled; EOF
Dec 9 01:18:47.109452361 (81h49m46.980535396s) [noise=true , address=45.91.116.9:4287 , piece_id=GUUNM5MV3J7OELO633ESY3EMGLJOZKXNUKT3SRI7GKYJDYIC6SPA, seg_pos={0 0}, upload=71502]: Long tail cancellation due to optimal threshold
Dec 9 01:18:47.109521943 (81h49m46.980604978s) [noise=true , address=145.79.227.4:4205 , piece_id=BWNYAT67IELSPLQTYMAM2O76OLQWUTXACQXR4VZSAQE67NYOASRA, seg_pos={0 0}, upload=71502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pih2cgjPo5YeP6B7g8diM7p11VRJfHy5H34GUT9CK77W2cTLr): protocol: expected piece hash; context canceled; EOF
Dec 9 01:18:47.109527924 (81h49m46.980610969s) [noise=true , address=145.79.227.4:4205 , piece_id=BWNYAT67IELSPLQTYMAM2O76OLQWUTXACQXR4VZSAQE67NYOASRA, seg_pos={0 0}, upload=71502]: Long tail cancellation due to optimal threshold
Dec 9 01:18:47.109629788 (81h49m46.980712823s) [noise=true , address=77.90.31.16:4736 , piece_id=BHZSQ7MXD2X4YEGL6IYMUYCHURUXDRRRJDYPTBVZ44SORXMPSO5A, seg_pos={0 0}, upload=71502]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk): protocol: expected piece hash; context canceled; EOF
Dec 9 01:18:47.109635399 (81h49m46.980718444s) [noise=true , address=77.90.31.16:4736 , piece_id=BHZSQ7MXD2X4YEGL6IYMUYCHURUXDRRRJDYPTBVZ44SORXMPSO5A, seg_pos={0 0}, upload=71502]: Long tail cancellation due to optimal threshold
Dec 9 01:18:47.109669504 (81h49m46.980752549s) [seg_pos={0 0}, upload=71502]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 9 01:18:47.109759546 (81h49m46.980842591s) [upload=71502]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 9 01:18:47.109766839 (81h49m46.980849874s) [upload=71502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 9 01:19:58.768357796 (81h50m58.639440831s) [upload=71502]: Done uploading segments...
Dec 9 01:19:58.768409825 (81h50m58.63949286s) [upload=71502]: Upload finished. err: metaclient: context deadline exceeded
Duration: 6.14044013s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [....X.X.........................................X.X.....X...] duration:
5.886286054s trace:
https://jaeger.dev.storj.io/trace/5280cd334ed3ed6b
FAIL (2025-12-09 02:06:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.886316561s
core
uplink
us-select-1
us1-placement-20
|