Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 498643 reports (Page 792 of 9973)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
10 out of 60 is failed (threshold=3) [X...........XX.....X..XX..X.............X.X............X....]
duration:
25.072035268s
trace:
https://jaeger.dev.storj.io/trace/78cb4176e79a71ef
FAIL (2026-01-16 13:30:18 UTC)
orbiter warning: context deadline exceeded
Duration: 25.072062168s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
44 out of 60 is failed (threshold=3) [.X..X..XXX..XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXX]
duration:
30.001436622s
trace:
https://jaeger.dev.storj.io/trace/55ea8cbaf9cb4110
FAIL (2026-01-16 13:30:12 UTC)
orbiter warning: context deadline exceeded
Duration: 30.00144572s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
43 out of 60 is failed (threshold=3) [..X..X..XXX..XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XX]
duration:
30.001160455s
trace:
https://jaeger.dev.storj.io/trace/7164121e7053f196
FAIL (2026-01-16 13:29:42 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001180063s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.001422899s
trace:
https://jaeger.dev.storj.io/trace/84615609befaf2a
FAIL (2026-01-16 13:29:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001464137s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
12.030027453s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:29:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 12.030048181s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
10 out of 60 is failed (threshold=3) [.X...........XX.....X..XX..X.............X.X............X...]
duration:
22.345322286s
trace:
https://jaeger.dev.storj.io/trace/78cb4176e79a71ef
FAIL (2026-01-16 13:29:25 UTC)
orbiter warning: context deadline exceeded
Duration: 22.345336081s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
4.613007354s
trace:
https://jaeger.dev.storj.io/trace/6ac760c3037b3593
FAIL (2026-01-16 13:29:19 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
2 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722288682 (21h21m23.615997291s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722876211 (21h21m23.61658482s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723569079 (21h21m23.617277688s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723941439 (21h21m23.617650048s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724363121 (21h21m23.61807173s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724842575 (21h21m23.618551184s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725554540 (21h21m23.619263149s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725964200 (21h21m23.619672809s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.726335728 (21h21m23.620044337s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:27.560894061 (21h21m24.45460267s) [upload=18762]: Next returned nil segment
Jan 16 13:17:27.560910281 (21h21m24.454618891s) [upload=18762]: Waiting for error group managing segments...
Jan 16 13:17:27.945425729 (21h21m24.839134339s) [noise=true , address=81.171.14.70:4034    , piece_id=ZA776MIHYVMNWMCOAGA7WYW6BVRPANUX4TJRLX6GMYDU4DTGZ6CA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.956290948 (21h21m24.849999567s) [noise=true , address=81.171.14.70:4037    , piece_id=H2BG5BQ4UMJV7BAM43YAZ5HGE7O74EFGZVOVIDI6KIUMGTM24OXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.983831887 (21h21m24.877540496s) [noise=true , address=81.171.14.70:4039    , piece_id=TBLCG5AMUCBUWR45LPUCYHXTJZLZV75EU2X5IKUBN5JFUX33K54A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.280198203 (21h21m25.173906812s) [noise=true , address=185.167.204.206:4039 , piece_id=G2JP4HHLFHSWDHU67PRKS7EIBBEBDZLQOXXJIGRQHO3RIZBLGIGA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.281488720 (21h21m25.17519734s) [noise=true , address=185.167.204.205:4013 , piece_id=6XPHZALMBYEHTVZ7C2DYXVMZYMY6HRVTFUXYYBMWHKR6IYVLGH5A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.284120892 (21h21m25.177829501s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285046325 (21h21m25.178754934s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285665823 (21h21m25.179374432s) [noise=true , address=185.167.204.206:4038 , piece_id=4H57SSKIGROBCFDUM5WB3YFVJA6AUE42D4AU2KHJB3Q7N6GF73BQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.291712667 (21h21m25.185421286s) [noise=true , address=185.167.204.206:4066 , piece_id=DP62DGXBE55ONIZD4DDDL5544OCE6FGCLLNO3RAAXB2VTG64T5PQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.295213023 (21h21m25.188921632s) [noise=true , address=185.167.204.205:4020 , piece_id=MA26L34HT3YP73NBQS7DTMBIIJROPM6NF64QKVA6Q47DEXK2RX3A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.307407401 (21h21m25.20111601s) [noise=true , address=185.167.204.205:4032 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.310107492 (21h21m25.203816101s) [noise=true , address=185.167.204.205:4029 , piece_id=RCWMPPEAJLPKP63ELZDK2CYBIHIT3M6TQRCAFK6R7SPECOJKEIXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.322002311 (21h21m25.21571092s) [noise=true , address=185.167.204.205:4012 , piece_id=7AFHUFBMXECJED52TRDXCVPINKTYIPKM43F5WAUXV7QKW7KHLJVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.323634799 (21h21m25.217343408s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.331030100 (21h21m25.224738719s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.337274880 (21h21m25.230983499s) [noise=true , address=185.167.204.206:4037 , piece_id=PJYGSROZJ247UOVND2X5OMG3MQSIUVJMEEZDZR7EQH7BDEMSHYMQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.344183495 (21h21m25.237892114s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.348015311 (21h21m25.24172392s) [noise=true , address=185.167.204.205:4002 , piece_id=242AZEDTHJ3L3FQZ2TRSEPZPFMGAWH3GNVPHYGSWSPD6V5SYSSVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.351754099 (21h21m25.245462708s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.449406444 (21h21m25.343115053s) [noise=true , address=81.171.14.70:4047    , piece_id=NU2VXV4PRXSKJUP2OJN7YCTKHSQE7WBT3RNZHPSO6BUUUCLCZF2Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.465347397 (21h21m25.359056006s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.669529300 (21h21m25.563237909s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:29.134944464 (21h21m26.028653073s) [noise=true , address=89.149.201.147:4012  , piece_id=2QP2NMLHYU5E6QJK4B2TZUHCQE54WYGKBUP22WOEYAJTKYIYHJUQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:18:26.064313509 (21h22m22.958022118s) [noise=true , address=89.149.201.147:4004  , piece_id=I5ITMFW3CTPLOB42YO4VSSMKWI35ZUBZDU4VFO3AP3CT3E4G337Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 188.166.225.170:37534->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064384153 (21h22m22.958092762s) [noise=true , address=89.149.201.147:4015  , piece_id=7MVSZN7QUE2N4ZGNSAAUUJ3B7TPGQFRKTAAE4SQU2J7N6AJIP3LA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: read tcp 188.166.225.170:51158->89.149.201.147:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064619662 (21h22m22.958328271s) [noise=true , address=89.149.201.147:4009  , piece_id=Y5JGHLAJO3XDIKVGOWESJSPITDGDMVTDMSGO644PRDILKSOOP5IQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 188.166.225.170:48506->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064812540 (21h22m22.958521149s) [noise=true , address=89.149.201.147:4010  , piece_id=XE76XPHQNE3BE5G7IGQBXNLE3NPSFWL64EQQRLNBZJVCO42Y4A6Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 188.166.225.170:36056->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064883825 (21h22m22.958592434s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:51176->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064920395 (21h22m22.958629004s) [seg_pos={0 0}, upload=18762]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 16 13:18:26.246995104 (21h22m23.140703713s) [upload=18762]: Done uploading segments...
Jan 16 13:18:26.247030952 (21h22m23.140739571s) [upload=18762]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 4.613024426s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
10 out of 60 is failed (threshold=3) [..X...........XX.....X..XX..X.............X.X............X..]
duration:
27.958936803s
trace:
https://jaeger.dev.storj.io/trace/78cb4176e79a71ef
FAIL (2026-01-16 13:29:02 UTC)
orbiter warning: context deadline exceeded
Duration: 27.958962731s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
15.133867522s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:29:02 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 15.133922706s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
43 out of 60 is failed (threshold=3) [X..X..X..XXX..XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..X]
duration:
30.000686643s
trace:
https://jaeger.dev.storj.io/trace/2c6632706d383d55
FAIL (2026-01-16 13:28:59 UTC)
orbiter warning: context deadline exceeded
Duration: 30.000717852s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.000779872s
trace:
https://jaeger.dev.storj.io/trace/4f3438407052325b
FAIL (2026-01-16 13:28:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000799468s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
7.629696796s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:28:26 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 7.629722116s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
5.04923298s
trace:
https://jaeger.dev.storj.io/trace/6ac760c3037b3593
FAIL (2026-01-16 13:28:21 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
2 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722288682 (21h21m23.615997291s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722876211 (21h21m23.61658482s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723569079 (21h21m23.617277688s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723941439 (21h21m23.617650048s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724363121 (21h21m23.61807173s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724842575 (21h21m23.618551184s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725554540 (21h21m23.619263149s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725964200 (21h21m23.619672809s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.726335728 (21h21m23.620044337s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:27.560894061 (21h21m24.45460267s) [upload=18762]: Next returned nil segment
Jan 16 13:17:27.560910281 (21h21m24.454618891s) [upload=18762]: Waiting for error group managing segments...
Jan 16 13:17:27.945425729 (21h21m24.839134339s) [noise=true , address=81.171.14.70:4034    , piece_id=ZA776MIHYVMNWMCOAGA7WYW6BVRPANUX4TJRLX6GMYDU4DTGZ6CA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.956290948 (21h21m24.849999567s) [noise=true , address=81.171.14.70:4037    , piece_id=H2BG5BQ4UMJV7BAM43YAZ5HGE7O74EFGZVOVIDI6KIUMGTM24OXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.983831887 (21h21m24.877540496s) [noise=true , address=81.171.14.70:4039    , piece_id=TBLCG5AMUCBUWR45LPUCYHXTJZLZV75EU2X5IKUBN5JFUX33K54A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.280198203 (21h21m25.173906812s) [noise=true , address=185.167.204.206:4039 , piece_id=G2JP4HHLFHSWDHU67PRKS7EIBBEBDZLQOXXJIGRQHO3RIZBLGIGA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.281488720 (21h21m25.17519734s) [noise=true , address=185.167.204.205:4013 , piece_id=6XPHZALMBYEHTVZ7C2DYXVMZYMY6HRVTFUXYYBMWHKR6IYVLGH5A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.284120892 (21h21m25.177829501s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285046325 (21h21m25.178754934s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285665823 (21h21m25.179374432s) [noise=true , address=185.167.204.206:4038 , piece_id=4H57SSKIGROBCFDUM5WB3YFVJA6AUE42D4AU2KHJB3Q7N6GF73BQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.291712667 (21h21m25.185421286s) [noise=true , address=185.167.204.206:4066 , piece_id=DP62DGXBE55ONIZD4DDDL5544OCE6FGCLLNO3RAAXB2VTG64T5PQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.295213023 (21h21m25.188921632s) [noise=true , address=185.167.204.205:4020 , piece_id=MA26L34HT3YP73NBQS7DTMBIIJROPM6NF64QKVA6Q47DEXK2RX3A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.307407401 (21h21m25.20111601s) [noise=true , address=185.167.204.205:4032 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.310107492 (21h21m25.203816101s) [noise=true , address=185.167.204.205:4029 , piece_id=RCWMPPEAJLPKP63ELZDK2CYBIHIT3M6TQRCAFK6R7SPECOJKEIXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.322002311 (21h21m25.21571092s) [noise=true , address=185.167.204.205:4012 , piece_id=7AFHUFBMXECJED52TRDXCVPINKTYIPKM43F5WAUXV7QKW7KHLJVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.323634799 (21h21m25.217343408s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.331030100 (21h21m25.224738719s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.337274880 (21h21m25.230983499s) [noise=true , address=185.167.204.206:4037 , piece_id=PJYGSROZJ247UOVND2X5OMG3MQSIUVJMEEZDZR7EQH7BDEMSHYMQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.344183495 (21h21m25.237892114s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.348015311 (21h21m25.24172392s) [noise=true , address=185.167.204.205:4002 , piece_id=242AZEDTHJ3L3FQZ2TRSEPZPFMGAWH3GNVPHYGSWSPD6V5SYSSVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.351754099 (21h21m25.245462708s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.449406444 (21h21m25.343115053s) [noise=true , address=81.171.14.70:4047    , piece_id=NU2VXV4PRXSKJUP2OJN7YCTKHSQE7WBT3RNZHPSO6BUUUCLCZF2Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.465347397 (21h21m25.359056006s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.669529300 (21h21m25.563237909s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:29.134944464 (21h21m26.028653073s) [noise=true , address=89.149.201.147:4012  , piece_id=2QP2NMLHYU5E6QJK4B2TZUHCQE54WYGKBUP22WOEYAJTKYIYHJUQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:18:26.064313509 (21h22m22.958022118s) [noise=true , address=89.149.201.147:4004  , piece_id=I5ITMFW3CTPLOB42YO4VSSMKWI35ZUBZDU4VFO3AP3CT3E4G337Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 188.166.225.170:37534->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064384153 (21h22m22.958092762s) [noise=true , address=89.149.201.147:4015  , piece_id=7MVSZN7QUE2N4ZGNSAAUUJ3B7TPGQFRKTAAE4SQU2J7N6AJIP3LA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: read tcp 188.166.225.170:51158->89.149.201.147:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064619662 (21h22m22.958328271s) [noise=true , address=89.149.201.147:4009  , piece_id=Y5JGHLAJO3XDIKVGOWESJSPITDGDMVTDMSGO644PRDILKSOOP5IQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 188.166.225.170:48506->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064812540 (21h22m22.958521149s) [noise=true , address=89.149.201.147:4010  , piece_id=XE76XPHQNE3BE5G7IGQBXNLE3NPSFWL64EQQRLNBZJVCO42Y4A6Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 188.166.225.170:36056->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064883825 (21h22m22.958592434s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:51176->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064920395 (21h22m22.958629004s) [seg_pos={0 0}, upload=18762]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 16 13:18:26.246995104 (21h22m23.140703713s) [upload=18762]: Done uploading segments...
Jan 16 13:18:26.247030952 (21h22m23.140739571s) [upload=18762]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 5.049254961s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
43 out of 60 is failed (threshold=3) [XX..X..X..XXX..XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..]
duration:
28.592603049s
trace:
https://jaeger.dev.storj.io/trace/6d29ffbda3e7bbbe
FAIL (2026-01-16 13:28:09 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 28.592616825s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
10 out of 60 is failed (threshold=3) [...X...........XX.....X..XX..X.............X.X............X.]
duration:
37.86289838s
trace:
https://jaeger.dev.storj.io/trace/78cb4176e79a71ef
FAIL (2026-01-16 13:27:59 UTC)
orbiter warning: context deadline exceeded
Duration: 37.862910834s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
11.947728129s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:27:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 11.947753346s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
43 out of 60 is failed (threshold=3) [.XX..X..X..XXX..XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X.]
duration:
22.032948402s
trace:
https://jaeger.dev.storj.io/trace/6d29ffbda3e7bbbe
FAIL (2026-01-16 13:27:40 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 22.032973028s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
15.033799311s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:27:30 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 15.033819439s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
11 out of 60 is failed (threshold=3) [X...X...........XX.....X..XX..X.............X.X............X]
duration:
1m0.001069937s
trace:
https://jaeger.dev.storj.io/trace/78cb4176e79a71ef
FAIL (2026-01-16 13:27:21 UTC)
orbiter warning: context deadline exceeded
Duration: 1m0.001090867s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.00129314s
trace:
https://jaeger.dev.storj.io/trace/55c3faaf4e2dbce6
FAIL (2026-01-16 13:27:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001315303s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
4.603540008s
trace:
https://jaeger.dev.storj.io/trace/6ac760c3037b3593
FAIL (2026-01-16 13:27:12 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
2 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722288682 (21h21m23.615997291s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722876211 (21h21m23.61658482s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723569079 (21h21m23.617277688s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723941439 (21h21m23.617650048s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724363121 (21h21m23.61807173s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724842575 (21h21m23.618551184s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725554540 (21h21m23.619263149s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725964200 (21h21m23.619672809s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.726335728 (21h21m23.620044337s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:27.560894061 (21h21m24.45460267s) [upload=18762]: Next returned nil segment
Jan 16 13:17:27.560910281 (21h21m24.454618891s) [upload=18762]: Waiting for error group managing segments...
Jan 16 13:17:27.945425729 (21h21m24.839134339s) [noise=true , address=81.171.14.70:4034    , piece_id=ZA776MIHYVMNWMCOAGA7WYW6BVRPANUX4TJRLX6GMYDU4DTGZ6CA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.956290948 (21h21m24.849999567s) [noise=true , address=81.171.14.70:4037    , piece_id=H2BG5BQ4UMJV7BAM43YAZ5HGE7O74EFGZVOVIDI6KIUMGTM24OXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.983831887 (21h21m24.877540496s) [noise=true , address=81.171.14.70:4039    , piece_id=TBLCG5AMUCBUWR45LPUCYHXTJZLZV75EU2X5IKUBN5JFUX33K54A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.280198203 (21h21m25.173906812s) [noise=true , address=185.167.204.206:4039 , piece_id=G2JP4HHLFHSWDHU67PRKS7EIBBEBDZLQOXXJIGRQHO3RIZBLGIGA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.281488720 (21h21m25.17519734s) [noise=true , address=185.167.204.205:4013 , piece_id=6XPHZALMBYEHTVZ7C2DYXVMZYMY6HRVTFUXYYBMWHKR6IYVLGH5A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.284120892 (21h21m25.177829501s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285046325 (21h21m25.178754934s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285665823 (21h21m25.179374432s) [noise=true , address=185.167.204.206:4038 , piece_id=4H57SSKIGROBCFDUM5WB3YFVJA6AUE42D4AU2KHJB3Q7N6GF73BQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.291712667 (21h21m25.185421286s) [noise=true , address=185.167.204.206:4066 , piece_id=DP62DGXBE55ONIZD4DDDL5544OCE6FGCLLNO3RAAXB2VTG64T5PQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.295213023 (21h21m25.188921632s) [noise=true , address=185.167.204.205:4020 , piece_id=MA26L34HT3YP73NBQS7DTMBIIJROPM6NF64QKVA6Q47DEXK2RX3A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.307407401 (21h21m25.20111601s) [noise=true , address=185.167.204.205:4032 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.310107492 (21h21m25.203816101s) [noise=true , address=185.167.204.205:4029 , piece_id=RCWMPPEAJLPKP63ELZDK2CYBIHIT3M6TQRCAFK6R7SPECOJKEIXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.322002311 (21h21m25.21571092s) [noise=true , address=185.167.204.205:4012 , piece_id=7AFHUFBMXECJED52TRDXCVPINKTYIPKM43F5WAUXV7QKW7KHLJVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.323634799 (21h21m25.217343408s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.331030100 (21h21m25.224738719s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.337274880 (21h21m25.230983499s) [noise=true , address=185.167.204.206:4037 , piece_id=PJYGSROZJ247UOVND2X5OMG3MQSIUVJMEEZDZR7EQH7BDEMSHYMQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.344183495 (21h21m25.237892114s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.348015311 (21h21m25.24172392s) [noise=true , address=185.167.204.205:4002 , piece_id=242AZEDTHJ3L3FQZ2TRSEPZPFMGAWH3GNVPHYGSWSPD6V5SYSSVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.351754099 (21h21m25.245462708s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.449406444 (21h21m25.343115053s) [noise=true , address=81.171.14.70:4047    , piece_id=NU2VXV4PRXSKJUP2OJN7YCTKHSQE7WBT3RNZHPSO6BUUUCLCZF2Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.465347397 (21h21m25.359056006s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.669529300 (21h21m25.563237909s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:29.134944464 (21h21m26.028653073s) [noise=true , address=89.149.201.147:4012  , piece_id=2QP2NMLHYU5E6QJK4B2TZUHCQE54WYGKBUP22WOEYAJTKYIYHJUQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:18:26.064313509 (21h22m22.958022118s) [noise=true , address=89.149.201.147:4004  , piece_id=I5ITMFW3CTPLOB42YO4VSSMKWI35ZUBZDU4VFO3AP3CT3E4G337Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 188.166.225.170:37534->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064384153 (21h22m22.958092762s) [noise=true , address=89.149.201.147:4015  , piece_id=7MVSZN7QUE2N4ZGNSAAUUJ3B7TPGQFRKTAAE4SQU2J7N6AJIP3LA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: read tcp 188.166.225.170:51158->89.149.201.147:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064619662 (21h22m22.958328271s) [noise=true , address=89.149.201.147:4009  , piece_id=Y5JGHLAJO3XDIKVGOWESJSPITDGDMVTDMSGO644PRDILKSOOP5IQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 188.166.225.170:48506->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064812540 (21h22m22.958521149s) [noise=true , address=89.149.201.147:4010  , piece_id=XE76XPHQNE3BE5G7IGQBXNLE3NPSFWL64EQQRLNBZJVCO42Y4A6Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 188.166.225.170:36056->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064883825 (21h22m22.958592434s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:51176->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064920395 (21h22m22.958629004s) [seg_pos={0 0}, upload=18762]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 16 13:18:26.246995104 (21h22m23.140703713s) [upload=18762]: Done uploading segments...
Jan 16 13:18:26.247030952 (21h22m23.140739571s) [upload=18762]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 4.603567501s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
7.54880862s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:26:43 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 7.548833517s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
44 out of 60 is failed (threshold=3) [X.XX..X..X..XXX..XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X]
duration:
30.001123504s
trace:
https://jaeger.dev.storj.io/trace/6d29ffbda3e7bbbe
FAIL (2026-01-16 13:26:42 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001203386s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.000588778s
trace:
https://jaeger.dev.storj.io/trace/16c05bc7015690b0
FAIL (2026-01-16 13:26:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000607022s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
4.591108067s
trace:
https://jaeger.dev.storj.io/trace/6ac760c3037b3593
FAIL (2026-01-16 13:26:15 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
2 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722288682 (21h21m23.615997291s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722876211 (21h21m23.61658482s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723569079 (21h21m23.617277688s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723941439 (21h21m23.617650048s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724363121 (21h21m23.61807173s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724842575 (21h21m23.618551184s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725554540 (21h21m23.619263149s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725964200 (21h21m23.619672809s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.726335728 (21h21m23.620044337s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:27.560894061 (21h21m24.45460267s) [upload=18762]: Next returned nil segment
Jan 16 13:17:27.560910281 (21h21m24.454618891s) [upload=18762]: Waiting for error group managing segments...
Jan 16 13:17:27.945425729 (21h21m24.839134339s) [noise=true , address=81.171.14.70:4034    , piece_id=ZA776MIHYVMNWMCOAGA7WYW6BVRPANUX4TJRLX6GMYDU4DTGZ6CA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.956290948 (21h21m24.849999567s) [noise=true , address=81.171.14.70:4037    , piece_id=H2BG5BQ4UMJV7BAM43YAZ5HGE7O74EFGZVOVIDI6KIUMGTM24OXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.983831887 (21h21m24.877540496s) [noise=true , address=81.171.14.70:4039    , piece_id=TBLCG5AMUCBUWR45LPUCYHXTJZLZV75EU2X5IKUBN5JFUX33K54A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.280198203 (21h21m25.173906812s) [noise=true , address=185.167.204.206:4039 , piece_id=G2JP4HHLFHSWDHU67PRKS7EIBBEBDZLQOXXJIGRQHO3RIZBLGIGA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.281488720 (21h21m25.17519734s) [noise=true , address=185.167.204.205:4013 , piece_id=6XPHZALMBYEHTVZ7C2DYXVMZYMY6HRVTFUXYYBMWHKR6IYVLGH5A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.284120892 (21h21m25.177829501s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285046325 (21h21m25.178754934s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285665823 (21h21m25.179374432s) [noise=true , address=185.167.204.206:4038 , piece_id=4H57SSKIGROBCFDUM5WB3YFVJA6AUE42D4AU2KHJB3Q7N6GF73BQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.291712667 (21h21m25.185421286s) [noise=true , address=185.167.204.206:4066 , piece_id=DP62DGXBE55ONIZD4DDDL5544OCE6FGCLLNO3RAAXB2VTG64T5PQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.295213023 (21h21m25.188921632s) [noise=true , address=185.167.204.205:4020 , piece_id=MA26L34HT3YP73NBQS7DTMBIIJROPM6NF64QKVA6Q47DEXK2RX3A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.307407401 (21h21m25.20111601s) [noise=true , address=185.167.204.205:4032 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.310107492 (21h21m25.203816101s) [noise=true , address=185.167.204.205:4029 , piece_id=RCWMPPEAJLPKP63ELZDK2CYBIHIT3M6TQRCAFK6R7SPECOJKEIXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.322002311 (21h21m25.21571092s) [noise=true , address=185.167.204.205:4012 , piece_id=7AFHUFBMXECJED52TRDXCVPINKTYIPKM43F5WAUXV7QKW7KHLJVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.323634799 (21h21m25.217343408s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.331030100 (21h21m25.224738719s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.337274880 (21h21m25.230983499s) [noise=true , address=185.167.204.206:4037 , piece_id=PJYGSROZJ247UOVND2X5OMG3MQSIUVJMEEZDZR7EQH7BDEMSHYMQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.344183495 (21h21m25.237892114s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.348015311 (21h21m25.24172392s) [noise=true , address=185.167.204.205:4002 , piece_id=242AZEDTHJ3L3FQZ2TRSEPZPFMGAWH3GNVPHYGSWSPD6V5SYSSVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.351754099 (21h21m25.245462708s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.449406444 (21h21m25.343115053s) [noise=true , address=81.171.14.70:4047    , piece_id=NU2VXV4PRXSKJUP2OJN7YCTKHSQE7WBT3RNZHPSO6BUUUCLCZF2Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.465347397 (21h21m25.359056006s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.669529300 (21h21m25.563237909s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:29.134944464 (21h21m26.028653073s) [noise=true , address=89.149.201.147:4012  , piece_id=2QP2NMLHYU5E6QJK4B2TZUHCQE54WYGKBUP22WOEYAJTKYIYHJUQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:18:26.064313509 (21h22m22.958022118s) [noise=true , address=89.149.201.147:4004  , piece_id=I5ITMFW3CTPLOB42YO4VSSMKWI35ZUBZDU4VFO3AP3CT3E4G337Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 188.166.225.170:37534->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064384153 (21h22m22.958092762s) [noise=true , address=89.149.201.147:4015  , piece_id=7MVSZN7QUE2N4ZGNSAAUUJ3B7TPGQFRKTAAE4SQU2J7N6AJIP3LA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: read tcp 188.166.225.170:51158->89.149.201.147:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064619662 (21h22m22.958328271s) [noise=true , address=89.149.201.147:4009  , piece_id=Y5JGHLAJO3XDIKVGOWESJSPITDGDMVTDMSGO644PRDILKSOOP5IQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 188.166.225.170:48506->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064812540 (21h22m22.958521149s) [noise=true , address=89.149.201.147:4010  , piece_id=XE76XPHQNE3BE5G7IGQBXNLE3NPSFWL64EQQRLNBZJVCO42Y4A6Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 188.166.225.170:36056->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064883825 (21h22m22.958592434s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:51176->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064920395 (21h22m22.958629004s) [seg_pos={0 0}, upload=18762]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 16 13:18:26.246995104 (21h22m23.140703713s) [upload=18762]: Done uploading segments...
Jan 16 13:18:26.247030952 (21h22m23.140739571s) [upload=18762]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 4.591135969s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
10 out of 60 is failed (threshold=3) [.X...X...........XX.....X..XX..X.............X.X............]
duration:
22.379949151s
trace:
https://jaeger.dev.storj.io/trace/dbd7e442c5bdeaf
FAIL (2026-01-16 13:25:59 UTC)
orbiter warning: context deadline exceeded
Duration: 22.379976723s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
5.849316391s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:25:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 5.849339164s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.002065221s
trace:
https://jaeger.dev.storj.io/trace/75d502340fa3605d
FAIL (2026-01-16 13:25:34 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.002089616s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
4.418720421s
trace:
https://jaeger.dev.storj.io/trace/6ac760c3037b3593
FAIL (2026-01-16 13:25:22 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
2 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722288682 (21h21m23.615997291s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722876211 (21h21m23.61658482s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723569079 (21h21m23.617277688s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723941439 (21h21m23.617650048s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724363121 (21h21m23.61807173s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724842575 (21h21m23.618551184s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725554540 (21h21m23.619263149s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725964200 (21h21m23.619672809s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.726335728 (21h21m23.620044337s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:27.560894061 (21h21m24.45460267s) [upload=18762]: Next returned nil segment
Jan 16 13:17:27.560910281 (21h21m24.454618891s) [upload=18762]: Waiting for error group managing segments...
Jan 16 13:17:27.945425729 (21h21m24.839134339s) [noise=true , address=81.171.14.70:4034    , piece_id=ZA776MIHYVMNWMCOAGA7WYW6BVRPANUX4TJRLX6GMYDU4DTGZ6CA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.956290948 (21h21m24.849999567s) [noise=true , address=81.171.14.70:4037    , piece_id=H2BG5BQ4UMJV7BAM43YAZ5HGE7O74EFGZVOVIDI6KIUMGTM24OXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.983831887 (21h21m24.877540496s) [noise=true , address=81.171.14.70:4039    , piece_id=TBLCG5AMUCBUWR45LPUCYHXTJZLZV75EU2X5IKUBN5JFUX33K54A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.280198203 (21h21m25.173906812s) [noise=true , address=185.167.204.206:4039 , piece_id=G2JP4HHLFHSWDHU67PRKS7EIBBEBDZLQOXXJIGRQHO3RIZBLGIGA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.281488720 (21h21m25.17519734s) [noise=true , address=185.167.204.205:4013 , piece_id=6XPHZALMBYEHTVZ7C2DYXVMZYMY6HRVTFUXYYBMWHKR6IYVLGH5A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.284120892 (21h21m25.177829501s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285046325 (21h21m25.178754934s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285665823 (21h21m25.179374432s) [noise=true , address=185.167.204.206:4038 , piece_id=4H57SSKIGROBCFDUM5WB3YFVJA6AUE42D4AU2KHJB3Q7N6GF73BQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.291712667 (21h21m25.185421286s) [noise=true , address=185.167.204.206:4066 , piece_id=DP62DGXBE55ONIZD4DDDL5544OCE6FGCLLNO3RAAXB2VTG64T5PQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.295213023 (21h21m25.188921632s) [noise=true , address=185.167.204.205:4020 , piece_id=MA26L34HT3YP73NBQS7DTMBIIJROPM6NF64QKVA6Q47DEXK2RX3A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.307407401 (21h21m25.20111601s) [noise=true , address=185.167.204.205:4032 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.310107492 (21h21m25.203816101s) [noise=true , address=185.167.204.205:4029 , piece_id=RCWMPPEAJLPKP63ELZDK2CYBIHIT3M6TQRCAFK6R7SPECOJKEIXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.322002311 (21h21m25.21571092s) [noise=true , address=185.167.204.205:4012 , piece_id=7AFHUFBMXECJED52TRDXCVPINKTYIPKM43F5WAUXV7QKW7KHLJVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.323634799 (21h21m25.217343408s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.331030100 (21h21m25.224738719s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.337274880 (21h21m25.230983499s) [noise=true , address=185.167.204.206:4037 , piece_id=PJYGSROZJ247UOVND2X5OMG3MQSIUVJMEEZDZR7EQH7BDEMSHYMQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.344183495 (21h21m25.237892114s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.348015311 (21h21m25.24172392s) [noise=true , address=185.167.204.205:4002 , piece_id=242AZEDTHJ3L3FQZ2TRSEPZPFMGAWH3GNVPHYGSWSPD6V5SYSSVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.351754099 (21h21m25.245462708s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.449406444 (21h21m25.343115053s) [noise=true , address=81.171.14.70:4047    , piece_id=NU2VXV4PRXSKJUP2OJN7YCTKHSQE7WBT3RNZHPSO6BUUUCLCZF2Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.465347397 (21h21m25.359056006s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.669529300 (21h21m25.563237909s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:29.134944464 (21h21m26.028653073s) [noise=true , address=89.149.201.147:4012  , piece_id=2QP2NMLHYU5E6QJK4B2TZUHCQE54WYGKBUP22WOEYAJTKYIYHJUQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:18:26.064313509 (21h22m22.958022118s) [noise=true , address=89.149.201.147:4004  , piece_id=I5ITMFW3CTPLOB42YO4VSSMKWI35ZUBZDU4VFO3AP3CT3E4G337Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 188.166.225.170:37534->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064384153 (21h22m22.958092762s) [noise=true , address=89.149.201.147:4015  , piece_id=7MVSZN7QUE2N4ZGNSAAUUJ3B7TPGQFRKTAAE4SQU2J7N6AJIP3LA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: read tcp 188.166.225.170:51158->89.149.201.147:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064619662 (21h22m22.958328271s) [noise=true , address=89.149.201.147:4009  , piece_id=Y5JGHLAJO3XDIKVGOWESJSPITDGDMVTDMSGO644PRDILKSOOP5IQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 188.166.225.170:48506->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064812540 (21h22m22.958521149s) [noise=true , address=89.149.201.147:4010  , piece_id=XE76XPHQNE3BE5G7IGQBXNLE3NPSFWL64EQQRLNBZJVCO42Y4A6Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 188.166.225.170:36056->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064883825 (21h22m22.958592434s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:51176->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064920395 (21h22m22.958629004s) [seg_pos={0 0}, upload=18762]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 16 13:18:26.246995104 (21h22m23.140703713s) [upload=18762]: Done uploading segments...
Jan 16 13:18:26.247030952 (21h22m23.140739571s) [upload=18762]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 4.418757492s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
10 out of 60 is failed (threshold=3) [..X...X...........XX.....X..XX..X.............X.X...........]
duration:
32.581502674s
trace:
https://jaeger.dev.storj.io/trace/dbd7e442c5bdeaf
FAIL (2026-01-16 13:25:22 UTC)
orbiter warning: context deadline exceeded
Duration: 32.581545154s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
44 out of 60 is failed (threshold=3) [XX.XX..X..X..XXX..XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.]
duration:
14.743325662s
trace:
https://jaeger.dev.storj.io/trace/60a1004cb68dc91c
FAIL (2026-01-16 13:25:19 UTC)
orbiter warning: context deadline exceeded
Duration: 14.743399543s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
5.138786796s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:25:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 5.138819248s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
44 out of 60 is failed (threshold=3) [.XX.XX..X..X..XXX..XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX]
duration:
30.00210662s
trace:
https://jaeger.dev.storj.io/trace/60a1004cb68dc91c
FAIL (2026-01-16 13:25:04 UTC)
orbiter warning: context deadline exceeded
Duration: 30.002123252s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.000302043s
trace:
https://jaeger.dev.storj.io/trace/49d8fbe51d75a567
FAIL (2026-01-16 13:24:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000324185s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
15.541912152s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:24:55 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 15.541977115s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.000706913s
trace:
https://jaeger.dev.storj.io/trace/6dd157da55e434cd
FAIL (2026-01-16 13:24:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000728433s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
4.762367961s
trace:
https://jaeger.dev.storj.io/trace/6ac760c3037b3593
FAIL (2026-01-16 13:24:35 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
2 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722288682 (21h21m23.615997291s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722876211 (21h21m23.61658482s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723569079 (21h21m23.617277688s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723941439 (21h21m23.617650048s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724363121 (21h21m23.61807173s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724842575 (21h21m23.618551184s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725554540 (21h21m23.619263149s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725964200 (21h21m23.619672809s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.726335728 (21h21m23.620044337s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:27.560894061 (21h21m24.45460267s) [upload=18762]: Next returned nil segment
Jan 16 13:17:27.560910281 (21h21m24.454618891s) [upload=18762]: Waiting for error group managing segments...
Jan 16 13:17:27.945425729 (21h21m24.839134339s) [noise=true , address=81.171.14.70:4034    , piece_id=ZA776MIHYVMNWMCOAGA7WYW6BVRPANUX4TJRLX6GMYDU4DTGZ6CA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.956290948 (21h21m24.849999567s) [noise=true , address=81.171.14.70:4037    , piece_id=H2BG5BQ4UMJV7BAM43YAZ5HGE7O74EFGZVOVIDI6KIUMGTM24OXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.983831887 (21h21m24.877540496s) [noise=true , address=81.171.14.70:4039    , piece_id=TBLCG5AMUCBUWR45LPUCYHXTJZLZV75EU2X5IKUBN5JFUX33K54A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.280198203 (21h21m25.173906812s) [noise=true , address=185.167.204.206:4039 , piece_id=G2JP4HHLFHSWDHU67PRKS7EIBBEBDZLQOXXJIGRQHO3RIZBLGIGA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.281488720 (21h21m25.17519734s) [noise=true , address=185.167.204.205:4013 , piece_id=6XPHZALMBYEHTVZ7C2DYXVMZYMY6HRVTFUXYYBMWHKR6IYVLGH5A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.284120892 (21h21m25.177829501s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285046325 (21h21m25.178754934s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285665823 (21h21m25.179374432s) [noise=true , address=185.167.204.206:4038 , piece_id=4H57SSKIGROBCFDUM5WB3YFVJA6AUE42D4AU2KHJB3Q7N6GF73BQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.291712667 (21h21m25.185421286s) [noise=true , address=185.167.204.206:4066 , piece_id=DP62DGXBE55ONIZD4DDDL5544OCE6FGCLLNO3RAAXB2VTG64T5PQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.295213023 (21h21m25.188921632s) [noise=true , address=185.167.204.205:4020 , piece_id=MA26L34HT3YP73NBQS7DTMBIIJROPM6NF64QKVA6Q47DEXK2RX3A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.307407401 (21h21m25.20111601s) [noise=true , address=185.167.204.205:4032 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.310107492 (21h21m25.203816101s) [noise=true , address=185.167.204.205:4029 , piece_id=RCWMPPEAJLPKP63ELZDK2CYBIHIT3M6TQRCAFK6R7SPECOJKEIXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.322002311 (21h21m25.21571092s) [noise=true , address=185.167.204.205:4012 , piece_id=7AFHUFBMXECJED52TRDXCVPINKTYIPKM43F5WAUXV7QKW7KHLJVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.323634799 (21h21m25.217343408s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.331030100 (21h21m25.224738719s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.337274880 (21h21m25.230983499s) [noise=true , address=185.167.204.206:4037 , piece_id=PJYGSROZJ247UOVND2X5OMG3MQSIUVJMEEZDZR7EQH7BDEMSHYMQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.344183495 (21h21m25.237892114s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.348015311 (21h21m25.24172392s) [noise=true , address=185.167.204.205:4002 , piece_id=242AZEDTHJ3L3FQZ2TRSEPZPFMGAWH3GNVPHYGSWSPD6V5SYSSVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.351754099 (21h21m25.245462708s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.449406444 (21h21m25.343115053s) [noise=true , address=81.171.14.70:4047    , piece_id=NU2VXV4PRXSKJUP2OJN7YCTKHSQE7WBT3RNZHPSO6BUUUCLCZF2Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.465347397 (21h21m25.359056006s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.669529300 (21h21m25.563237909s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:29.134944464 (21h21m26.028653073s) [noise=true , address=89.149.201.147:4012  , piece_id=2QP2NMLHYU5E6QJK4B2TZUHCQE54WYGKBUP22WOEYAJTKYIYHJUQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:18:26.064313509 (21h22m22.958022118s) [noise=true , address=89.149.201.147:4004  , piece_id=I5ITMFW3CTPLOB42YO4VSSMKWI35ZUBZDU4VFO3AP3CT3E4G337Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 188.166.225.170:37534->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064384153 (21h22m22.958092762s) [noise=true , address=89.149.201.147:4015  , piece_id=7MVSZN7QUE2N4ZGNSAAUUJ3B7TPGQFRKTAAE4SQU2J7N6AJIP3LA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: read tcp 188.166.225.170:51158->89.149.201.147:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064619662 (21h22m22.958328271s) [noise=true , address=89.149.201.147:4009  , piece_id=Y5JGHLAJO3XDIKVGOWESJSPITDGDMVTDMSGO644PRDILKSOOP5IQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 188.166.225.170:48506->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064812540 (21h22m22.958521149s) [noise=true , address=89.149.201.147:4010  , piece_id=XE76XPHQNE3BE5G7IGQBXNLE3NPSFWL64EQQRLNBZJVCO42Y4A6Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 188.166.225.170:36056->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064883825 (21h22m22.958592434s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:51176->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064920395 (21h22m22.958629004s) [seg_pos={0 0}, upload=18762]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 16 13:18:26.246995104 (21h22m23.140703713s) [upload=18762]: Done uploading segments...
Jan 16 13:18:26.247030952 (21h22m23.140739571s) [upload=18762]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 4.762392648s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
44 out of 60 is failed (threshold=3) [X.XX.XX..X..X..XXX..XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XX]
duration:
30.001455206s
trace:
https://jaeger.dev.storj.io/trace/1001b39a29490401
FAIL (2026-01-16 13:24:34 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001477097s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
10 out of 60 is failed (threshold=3) [...X...X...........XX.....X..XX..X.............X.X..........]
duration:
26.092689023s
trace:
https://jaeger.dev.storj.io/trace/dbd7e442c5bdeaf
FAIL (2026-01-16 13:24:29 UTC)
orbiter warning: context deadline exceeded
Duration: 26.092717318s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
9.75425847s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:24:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 9.754276314s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.001182799s
trace:
https://jaeger.dev.storj.io/trace/4db1c371a59f127
FAIL (2026-01-16 13:24:20 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001201665s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
4.447433041s
trace:
https://jaeger.dev.storj.io/trace/6ac760c3037b3593
FAIL (2026-01-16 13:24:12 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
2 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722288682 (21h21m23.615997291s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722876211 (21h21m23.61658482s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723569079 (21h21m23.617277688s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723941439 (21h21m23.617650048s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724363121 (21h21m23.61807173s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724842575 (21h21m23.618551184s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725554540 (21h21m23.619263149s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725964200 (21h21m23.619672809s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.726335728 (21h21m23.620044337s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:27.560894061 (21h21m24.45460267s) [upload=18762]: Next returned nil segment
Jan 16 13:17:27.560910281 (21h21m24.454618891s) [upload=18762]: Waiting for error group managing segments...
Jan 16 13:17:27.945425729 (21h21m24.839134339s) [noise=true , address=81.171.14.70:4034    , piece_id=ZA776MIHYVMNWMCOAGA7WYW6BVRPANUX4TJRLX6GMYDU4DTGZ6CA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.956290948 (21h21m24.849999567s) [noise=true , address=81.171.14.70:4037    , piece_id=H2BG5BQ4UMJV7BAM43YAZ5HGE7O74EFGZVOVIDI6KIUMGTM24OXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.983831887 (21h21m24.877540496s) [noise=true , address=81.171.14.70:4039    , piece_id=TBLCG5AMUCBUWR45LPUCYHXTJZLZV75EU2X5IKUBN5JFUX33K54A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.280198203 (21h21m25.173906812s) [noise=true , address=185.167.204.206:4039 , piece_id=G2JP4HHLFHSWDHU67PRKS7EIBBEBDZLQOXXJIGRQHO3RIZBLGIGA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.281488720 (21h21m25.17519734s) [noise=true , address=185.167.204.205:4013 , piece_id=6XPHZALMBYEHTVZ7C2DYXVMZYMY6HRVTFUXYYBMWHKR6IYVLGH5A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.284120892 (21h21m25.177829501s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285046325 (21h21m25.178754934s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285665823 (21h21m25.179374432s) [noise=true , address=185.167.204.206:4038 , piece_id=4H57SSKIGROBCFDUM5WB3YFVJA6AUE42D4AU2KHJB3Q7N6GF73BQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.291712667 (21h21m25.185421286s) [noise=true , address=185.167.204.206:4066 , piece_id=DP62DGXBE55ONIZD4DDDL5544OCE6FGCLLNO3RAAXB2VTG64T5PQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.295213023 (21h21m25.188921632s) [noise=true , address=185.167.204.205:4020 , piece_id=MA26L34HT3YP73NBQS7DTMBIIJROPM6NF64QKVA6Q47DEXK2RX3A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.307407401 (21h21m25.20111601s) [noise=true , address=185.167.204.205:4032 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.310107492 (21h21m25.203816101s) [noise=true , address=185.167.204.205:4029 , piece_id=RCWMPPEAJLPKP63ELZDK2CYBIHIT3M6TQRCAFK6R7SPECOJKEIXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.322002311 (21h21m25.21571092s) [noise=true , address=185.167.204.205:4012 , piece_id=7AFHUFBMXECJED52TRDXCVPINKTYIPKM43F5WAUXV7QKW7KHLJVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.323634799 (21h21m25.217343408s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.331030100 (21h21m25.224738719s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.337274880 (21h21m25.230983499s) [noise=true , address=185.167.204.206:4037 , piece_id=PJYGSROZJ247UOVND2X5OMG3MQSIUVJMEEZDZR7EQH7BDEMSHYMQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.344183495 (21h21m25.237892114s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.348015311 (21h21m25.24172392s) [noise=true , address=185.167.204.205:4002 , piece_id=242AZEDTHJ3L3FQZ2TRSEPZPFMGAWH3GNVPHYGSWSPD6V5SYSSVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.351754099 (21h21m25.245462708s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.449406444 (21h21m25.343115053s) [noise=true , address=81.171.14.70:4047    , piece_id=NU2VXV4PRXSKJUP2OJN7YCTKHSQE7WBT3RNZHPSO6BUUUCLCZF2Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.465347397 (21h21m25.359056006s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.669529300 (21h21m25.563237909s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:29.134944464 (21h21m26.028653073s) [noise=true , address=89.149.201.147:4012  , piece_id=2QP2NMLHYU5E6QJK4B2TZUHCQE54WYGKBUP22WOEYAJTKYIYHJUQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:18:26.064313509 (21h22m22.958022118s) [noise=true , address=89.149.201.147:4004  , piece_id=I5ITMFW3CTPLOB42YO4VSSMKWI35ZUBZDU4VFO3AP3CT3E4G337Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 188.166.225.170:37534->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064384153 (21h22m22.958092762s) [noise=true , address=89.149.201.147:4015  , piece_id=7MVSZN7QUE2N4ZGNSAAUUJ3B7TPGQFRKTAAE4SQU2J7N6AJIP3LA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: read tcp 188.166.225.170:51158->89.149.201.147:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064619662 (21h22m22.958328271s) [noise=true , address=89.149.201.147:4009  , piece_id=Y5JGHLAJO3XDIKVGOWESJSPITDGDMVTDMSGO644PRDILKSOOP5IQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 188.166.225.170:48506->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064812540 (21h22m22.958521149s) [noise=true , address=89.149.201.147:4010  , piece_id=XE76XPHQNE3BE5G7IGQBXNLE3NPSFWL64EQQRLNBZJVCO42Y4A6Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 188.166.225.170:36056->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064883825 (21h22m22.958592434s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:51176->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064920395 (21h22m22.958629004s) [seg_pos={0 0}, upload=18762]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 16 13:18:26.246995104 (21h22m23.140703713s) [upload=18762]: Done uploading segments...
Jan 16 13:18:26.247030952 (21h22m23.140739571s) [upload=18762]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 4.447462567s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
14.865950183s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:23:54 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 14.865976533s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
10 out of 60 is failed (threshold=3) [....X...X...........XX.....X..XX..X.............X.X.........]
duration:
16.073535777s
trace:
https://jaeger.dev.storj.io/trace/dbd7e442c5bdeaf
FAIL (2026-01-16 13:23:43 UTC)
orbiter warning: context deadline exceeded
Duration: 16.073549633s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
43 out of 60 is failed (threshold=3) [.X.XX.XX..X..X..XXX..XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..X]
duration:
30.00081691s
trace:
https://jaeger.dev.storj.io/trace/6321ad30849668f2
FAIL (2026-01-16 13:23:38 UTC)
orbiter warning: context deadline exceeded
Duration: 30.000839104s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.000918345s
trace:
https://jaeger.dev.storj.io/trace/7f087140b6790d3a
FAIL (2026-01-16 13:23:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000953212s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
10 out of 60 is failed (threshold=3) [.....X...X...........XX.....X..XX..X.............X.X........]
duration:
35.673741052s
trace:
https://jaeger.dev.storj.io/trace/dbd7e442c5bdeaf
FAIL (2026-01-16 13:23:27 UTC)
orbiter warning: context deadline exceeded
Duration: 35.673852273s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
4.312527014s
trace:
https://jaeger.dev.storj.io/trace/6ac760c3037b3593
FAIL (2026-01-16 13:23:17 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
2 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722288682 (21h21m23.615997291s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.722876211 (21h21m23.61658482s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723569079 (21h21m23.617277688s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.723941439 (21h21m23.617650048s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724363121 (21h21m23.61807173s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.724842575 (21h21m23.618551184s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725554540 (21h21m23.619263149s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.725964200 (21h21m23.619672809s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:26.726335728 (21h21m23.620044337s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Uploading piece...
Jan 16 13:17:27.560894061 (21h21m24.45460267s) [upload=18762]: Next returned nil segment
Jan 16 13:17:27.560910281 (21h21m24.454618891s) [upload=18762]: Waiting for error group managing segments...
Jan 16 13:17:27.945425729 (21h21m24.839134339s) [noise=true , address=81.171.14.70:4034    , piece_id=ZA776MIHYVMNWMCOAGA7WYW6BVRPANUX4TJRLX6GMYDU4DTGZ6CA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.956290948 (21h21m24.849999567s) [noise=true , address=81.171.14.70:4037    , piece_id=H2BG5BQ4UMJV7BAM43YAZ5HGE7O74EFGZVOVIDI6KIUMGTM24OXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:27.983831887 (21h21m24.877540496s) [noise=true , address=81.171.14.70:4039    , piece_id=TBLCG5AMUCBUWR45LPUCYHXTJZLZV75EU2X5IKUBN5JFUX33K54A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.280198203 (21h21m25.173906812s) [noise=true , address=185.167.204.206:4039 , piece_id=G2JP4HHLFHSWDHU67PRKS7EIBBEBDZLQOXXJIGRQHO3RIZBLGIGA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.281488720 (21h21m25.17519734s) [noise=true , address=185.167.204.205:4013 , piece_id=6XPHZALMBYEHTVZ7C2DYXVMZYMY6HRVTFUXYYBMWHKR6IYVLGH5A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.284120892 (21h21m25.177829501s) [noise=true , address=185.167.204.206:4070 , piece_id=QDBT4ZTVL6BW7MPTEPV3F3MJIMDUU6DKPYR3MKSZNXMIPMKBP3QQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285046325 (21h21m25.178754934s) [noise=true , address=185.167.204.206:4044 , piece_id=L5PV6I2R5JLCEDTFCV4XBYIE6YFAFJGTNULRSQKG2DDRCWGPUPBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.285665823 (21h21m25.179374432s) [noise=true , address=185.167.204.206:4038 , piece_id=4H57SSKIGROBCFDUM5WB3YFVJA6AUE42D4AU2KHJB3Q7N6GF73BQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.291712667 (21h21m25.185421286s) [noise=true , address=185.167.204.206:4066 , piece_id=DP62DGXBE55ONIZD4DDDL5544OCE6FGCLLNO3RAAXB2VTG64T5PQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.295213023 (21h21m25.188921632s) [noise=true , address=185.167.204.205:4020 , piece_id=MA26L34HT3YP73NBQS7DTMBIIJROPM6NF64QKVA6Q47DEXK2RX3A, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.307407401 (21h21m25.20111601s) [noise=true , address=185.167.204.205:4032 , piece_id=DG46UX3KLQLW234FM3SJVZBHXOLSTJ2L6ZH5OWF4H5DTKRFMM2PA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.310107492 (21h21m25.203816101s) [noise=true , address=185.167.204.205:4029 , piece_id=RCWMPPEAJLPKP63ELZDK2CYBIHIT3M6TQRCAFK6R7SPECOJKEIXA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.322002311 (21h21m25.21571092s) [noise=true , address=185.167.204.205:4012 , piece_id=7AFHUFBMXECJED52TRDXCVPINKTYIPKM43F5WAUXV7QKW7KHLJVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.323634799 (21h21m25.217343408s) [noise=true , address=185.167.204.206:4061 , piece_id=WNERU2YTN57OTHUVG4IMWGE67KKOR6DUJVWN6IQQ3C4ASET6466Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.331030100 (21h21m25.224738719s) [noise=true , address=185.167.204.205:4023 , piece_id=PZN6WLRWEZFGLVQS3ZPVE7FAK6JNYIYUZSIIK7VFXRF6S3YUFNJA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.337274880 (21h21m25.230983499s) [noise=true , address=185.167.204.206:4037 , piece_id=PJYGSROZJ247UOVND2X5OMG3MQSIUVJMEEZDZR7EQH7BDEMSHYMQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.344183495 (21h21m25.237892114s) [noise=true , address=185.167.204.205:4018 , piece_id=R7TDKBACAEVO6Q6B6SIJYSREYLZMGOHAMWJXBPFAIVHAV6DWESBA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.348015311 (21h21m25.24172392s) [noise=true , address=185.167.204.205:4002 , piece_id=242AZEDTHJ3L3FQZ2TRSEPZPFMGAWH3GNVPHYGSWSPD6V5SYSSVA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.351754099 (21h21m25.245462708s) [noise=true , address=185.167.204.205:4021 , piece_id=VEA5VKAJ5YD4IGBGIY3NVLMKC5ZLLLAEGIK6SK2R7HU36TL56VPA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.449406444 (21h21m25.343115053s) [noise=true , address=81.171.14.70:4047    , piece_id=NU2VXV4PRXSKJUP2OJN7YCTKHSQE7WBT3RNZHPSO6BUUUCLCZF2Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.465347397 (21h21m25.359056006s) [noise=true , address=81.171.14.70:4032    , piece_id=54FSJ32EDYVUYQAFAPK3HVFL5DU6TCIKSDHDZVINGX63GIX2V2SA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:28.669529300 (21h21m25.563237909s) [noise=true , address=89.149.201.147:4014  , piece_id=SO7G2O2VB5ZQH24MXHV3OL4CGXEWDLAYPI5OFUWD3C345M7TBSCA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:17:29.134944464 (21h21m26.028653073s) [noise=true , address=89.149.201.147:4012  , piece_id=2QP2NMLHYU5E6QJK4B2TZUHCQE54WYGKBUP22WOEYAJTKYIYHJUQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: <nil>
Jan 16 13:18:26.064313509 (21h22m22.958022118s) [noise=true , address=89.149.201.147:4004  , piece_id=I5ITMFW3CTPLOB42YO4VSSMKWI35ZUBZDU4VFO3AP3CT3E4G337Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 188.166.225.170:37534->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064384153 (21h22m22.958092762s) [noise=true , address=89.149.201.147:4015  , piece_id=7MVSZN7QUE2N4ZGNSAAUUJ3B7TPGQFRKTAAE4SQU2J7N6AJIP3LA, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: read tcp 188.166.225.170:51158->89.149.201.147:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064619662 (21h22m22.958328271s) [noise=true , address=89.149.201.147:4009  , piece_id=Y5JGHLAJO3XDIKVGOWESJSPITDGDMVTDMSGO644PRDILKSOOP5IQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 188.166.225.170:48506->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064812540 (21h22m22.958521149s) [noise=true , address=89.149.201.147:4010  , piece_id=XE76XPHQNE3BE5G7IGQBXNLE3NPSFWL64EQQRLNBZJVCO42Y4A6Q, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 188.166.225.170:36056->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064883825 (21h22m22.958592434s) [noise=true , address=89.149.201.147:4005  , piece_id=JMAQKDS3Z4EVYXLYY4J5ANYR4OKZIRQ5SF727NJSCKHGQOSVI4XQ, seg_pos={0 0}, upload=18762]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:51176->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:18:26.064920395 (21h22m22.958629004s) [seg_pos={0 0}, upload=18762]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 16 13:18:26.246995104 (21h22m23.140703713s) [upload=18762]: Done uploading segments...
Jan 16 13:18:26.247030952 (21h22m23.140739571s) [upload=18762]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 4.312554948s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
13.64969957s
trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:23:09 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 13.649738946s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
5.00069399s
trace:
https://jaeger.dev.storj.io/trace/1801d451c13c475
FAIL (2026-01-16 13:22:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000712906s core uplink us-select-1 us1-placement-20