Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
20.34186869s trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:47:19 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 20.341896533s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [.........................X.............X........X..X.XX.....] duration:
4.617644861s trace:
https://jaeger.dev.storj.io/trace/287073b7bf0613bb
FAIL (2026-01-16 13:47:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
s=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512857569 (21h47m7.406566178s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512903297 (21h47m7.406611906s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513163702 (21h47m7.406872311s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513210451 (21h47m7.40691906s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513428296 (21h47m7.407136906s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513547533 (21h47m7.407256152s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513938307 (21h47m7.407646916s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514317599 (21h47m7.408026208s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514667566 (21h47m7.408376175s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:11.336233602 (21h47m8.229942212s) [upload=19126]: Next returned nil segment
Jan 16 13:43:11.336267347 (21h47m8.229975956s) [upload=19126]: Waiting for error group managing segments...
Jan 16 13:43:11.728156896 (21h47m8.621865516s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.744681339 (21h47m8.638389948s) [noise=true , address=81.171.14.70:4031 , piece_id=I2QFNTRNW5BSEW443K4HEMRPFWDWMS4A7OGLCBGL6MOBLBIVHXGA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.781770550 (21h47m8.675479159s) [noise=true , address=81.171.14.70:4039 , piece_id=PJJUDVG42DYTROSHW2EQ37F5KXADJDEJFE6WNHHZ756KVWQHOMMQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.060761834 (21h47m8.954470453s) [noise=true , address=185.167.204.205:4033 , piece_id=WYD6DRJKUXEGOYG2JKXTSPE6MGZ3PHAGTUKFAXXD5UZMOVDJPETQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066620951 (21h47m8.96032957s) [noise=true , address=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066990785 (21h47m8.960699404s) [noise=true , address=185.167.204.205:4031 , piece_id=7QWMBCQS2HLDT6LYENQCTPGQFCYSFHDBHZCEDCLTJ3XGYBEIEIUQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.067370788 (21h47m8.961079407s) [noise=true , address=185.167.204.205:4027 , piece_id=65HE6VZ67VQWRVZ52QTIOJR4YTZVEZHW4YXLTB3I3MMACX3QU5KQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.070378284 (21h47m8.964086903s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080751365 (21h47m8.974459984s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080916139 (21h47m8.974624748s) [noise=true , address=185.167.204.205:4023 , piece_id=SP3YCSO77HYXX3XHWPWZM4KZNESTVCVQN74T4X4AZHIMGSXHYCYQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.081172958 (21h47m8.974881567s) [noise=true , address=185.167.204.205:4019 , piece_id=MOY2FK2KGUGPPJ2IT5564P4O4Y72ELKITH43E76MQNK5WBF2ZI2A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.090478015 (21h47m8.984186624s) [noise=true , address=185.167.204.205:4013 , piece_id=CAJYKOAHLSKEAAM6BR3S4G24JB7CZYAQ2MSEJBRC4PYTPSTFZD5A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.095728263 (21h47m8.989436872s) [noise=true , address=185.167.204.206:4064 , piece_id=4MG2QWPMQD6BYDRJVCBPLMAYOECLVNG3YZJ6JPK6RDKXMWMXUEFA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.097262153 (21h47m8.990970763s) [noise=true , address=185.167.204.205:4034 , piece_id=GX5ZKXOND7HFY6QSA5H4BAOS343XACNZYU7CWY5LBY3TISMJBRBQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.099826616 (21h47m8.993535225s) [noise=true , address=185.167.204.206:4058 , piece_id=QLKSPOBUDDAPJK5R2EMJP74XM6TEBQLRSCBW2D4SUDYLAF5GAWZA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.111103288 (21h47m9.004811897s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.122116057 (21h47m9.015824666s) [noise=true , address=185.167.204.205:4002 , piece_id=IF42VMTKTFOZPV7MVZ6XEZA2VZQ4W7OB6GOU56AGM4V6UCICLKKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.126871291 (21h47m9.0205799s) [noise=true , address=185.167.204.205:4015 , piece_id=FILYFJPIFRGG7GWSPSWQY2IBXAJPFNOUWGCP234KANWQJD5XPZUA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.127756125 (21h47m9.021464734s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.131797441 (21h47m9.02550605s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.152285220 (21h47m9.045993839s) [noise=true , address=185.167.204.206:4054 , piece_id=OR36BJX2U7KWL3YGZDAMRNLC44IDHRD4FXVZDP4XDLVWA73YHCIA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.154173035 (21h47m9.047881644s) [noise=true , address=185.167.204.206:4057 , piece_id=WXMMXS66XDZLHNXKIR44R5Q54CLCQN77YMKOZ2RM7MPVTXT3M67A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.397697308 (21h47m9.291405927s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.847835054 (21h47m9.741543664s) [noise=true , address=89.149.201.147:4003 , piece_id=E72MB7PBJQUMJJLOEQC4FDZO6PEZW5S2I6UH46JDPQBS7CKGHTJQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:44:09.858617030 (21h48m6.752325639s) [noise=true , address=89.149.201.147:4001 , piece_id=RBW4Y52Y7K4UPKZ6J67HOW5VN75YUFIHFRUYZYE3Y2O6WPOTIYXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection
Jan 16 13:44:09.858698235 (21h48m6.752406864s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 188.166.225.170:49424->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858727541 (21h48m6.75243616s) [noise=true , address=89.149.201.147:4017 , piece_id=VOZD426Q4XUTLC7WBYGSQ54BS6VK4KP5TQMZ7R4SNYDRZXBEIW6A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection
Jan 16 13:44:09.858851426 (21h48m6.752560035s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:59878->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858875492 (21h48m6.752584101s) [seg_pos={0 0}, upload=19126]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Jan 16 13:44:10.026477265 (21h48m6.920185874s) [upload=19126]: Done uploading segments...
Jan 16 13:44:10.026510469 (21h48m6.920219088s) [upload=19126]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.617670889s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.000724696s trace:
https://jaeger.dev.storj.io/trace/3248862cb0728f1f
FAIL (2026-01-16 13:46:54 UTC)
orbiter warning: context deadline exceeded
Duration: 30.000744976s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000791002s trace:
https://jaeger.dev.storj.io/trace/7b74923780b9f98f
FAIL (2026-01-16 13:46:45 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000813045s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
11.231556774s trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:46:41 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 11.231583035s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [X..XX..X.............X.X............X.............X..X..X...] duration:
57.965561711s trace:
https://jaeger.dev.storj.io/trace/5475a631601811f5
FAIL (2026-01-16 13:46:31 UTC)
orbiter warning: context deadline exceeded
Duration: 57.965591276s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [..........................X.............X........X..X.XX....] duration:
5.077939687s trace:
https://jaeger.dev.storj.io/trace/287073b7bf0613bb
FAIL (2026-01-16 13:46:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
s=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512857569 (21h47m7.406566178s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512903297 (21h47m7.406611906s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513163702 (21h47m7.406872311s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513210451 (21h47m7.40691906s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513428296 (21h47m7.407136906s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513547533 (21h47m7.407256152s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513938307 (21h47m7.407646916s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514317599 (21h47m7.408026208s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514667566 (21h47m7.408376175s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:11.336233602 (21h47m8.229942212s) [upload=19126]: Next returned nil segment
Jan 16 13:43:11.336267347 (21h47m8.229975956s) [upload=19126]: Waiting for error group managing segments...
Jan 16 13:43:11.728156896 (21h47m8.621865516s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.744681339 (21h47m8.638389948s) [noise=true , address=81.171.14.70:4031 , piece_id=I2QFNTRNW5BSEW443K4HEMRPFWDWMS4A7OGLCBGL6MOBLBIVHXGA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.781770550 (21h47m8.675479159s) [noise=true , address=81.171.14.70:4039 , piece_id=PJJUDVG42DYTROSHW2EQ37F5KXADJDEJFE6WNHHZ756KVWQHOMMQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.060761834 (21h47m8.954470453s) [noise=true , address=185.167.204.205:4033 , piece_id=WYD6DRJKUXEGOYG2JKXTSPE6MGZ3PHAGTUKFAXXD5UZMOVDJPETQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066620951 (21h47m8.96032957s) [noise=true , address=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066990785 (21h47m8.960699404s) [noise=true , address=185.167.204.205:4031 , piece_id=7QWMBCQS2HLDT6LYENQCTPGQFCYSFHDBHZCEDCLTJ3XGYBEIEIUQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.067370788 (21h47m8.961079407s) [noise=true , address=185.167.204.205:4027 , piece_id=65HE6VZ67VQWRVZ52QTIOJR4YTZVEZHW4YXLTB3I3MMACX3QU5KQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.070378284 (21h47m8.964086903s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080751365 (21h47m8.974459984s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080916139 (21h47m8.974624748s) [noise=true , address=185.167.204.205:4023 , piece_id=SP3YCSO77HYXX3XHWPWZM4KZNESTVCVQN74T4X4AZHIMGSXHYCYQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.081172958 (21h47m8.974881567s) [noise=true , address=185.167.204.205:4019 , piece_id=MOY2FK2KGUGPPJ2IT5564P4O4Y72ELKITH43E76MQNK5WBF2ZI2A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.090478015 (21h47m8.984186624s) [noise=true , address=185.167.204.205:4013 , piece_id=CAJYKOAHLSKEAAM6BR3S4G24JB7CZYAQ2MSEJBRC4PYTPSTFZD5A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.095728263 (21h47m8.989436872s) [noise=true , address=185.167.204.206:4064 , piece_id=4MG2QWPMQD6BYDRJVCBPLMAYOECLVNG3YZJ6JPK6RDKXMWMXUEFA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.097262153 (21h47m8.990970763s) [noise=true , address=185.167.204.205:4034 , piece_id=GX5ZKXOND7HFY6QSA5H4BAOS343XACNZYU7CWY5LBY3TISMJBRBQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.099826616 (21h47m8.993535225s) [noise=true , address=185.167.204.206:4058 , piece_id=QLKSPOBUDDAPJK5R2EMJP74XM6TEBQLRSCBW2D4SUDYLAF5GAWZA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.111103288 (21h47m9.004811897s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.122116057 (21h47m9.015824666s) [noise=true , address=185.167.204.205:4002 , piece_id=IF42VMTKTFOZPV7MVZ6XEZA2VZQ4W7OB6GOU56AGM4V6UCICLKKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.126871291 (21h47m9.0205799s) [noise=true , address=185.167.204.205:4015 , piece_id=FILYFJPIFRGG7GWSPSWQY2IBXAJPFNOUWGCP234KANWQJD5XPZUA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.127756125 (21h47m9.021464734s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.131797441 (21h47m9.02550605s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.152285220 (21h47m9.045993839s) [noise=true , address=185.167.204.206:4054 , piece_id=OR36BJX2U7KWL3YGZDAMRNLC44IDHRD4FXVZDP4XDLVWA73YHCIA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.154173035 (21h47m9.047881644s) [noise=true , address=185.167.204.206:4057 , piece_id=WXMMXS66XDZLHNXKIR44R5Q54CLCQN77YMKOZ2RM7MPVTXT3M67A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.397697308 (21h47m9.291405927s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.847835054 (21h47m9.741543664s) [noise=true , address=89.149.201.147:4003 , piece_id=E72MB7PBJQUMJJLOEQC4FDZO6PEZW5S2I6UH46JDPQBS7CKGHTJQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:44:09.858617030 (21h48m6.752325639s) [noise=true , address=89.149.201.147:4001 , piece_id=RBW4Y52Y7K4UPKZ6J67HOW5VN75YUFIHFRUYZYE3Y2O6WPOTIYXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection
Jan 16 13:44:09.858698235 (21h48m6.752406864s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 188.166.225.170:49424->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858727541 (21h48m6.75243616s) [noise=true , address=89.149.201.147:4017 , piece_id=VOZD426Q4XUTLC7WBYGSQ54BS6VK4KP5TQMZ7R4SNYDRZXBEIW6A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection
Jan 16 13:44:09.858851426 (21h48m6.752560035s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:59878->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858875492 (21h48m6.752584101s) [seg_pos={0 0}, upload=19126]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Jan 16 13:44:10.026477265 (21h48m6.920185874s) [upload=19126]: Done uploading segments...
Jan 16 13:44:10.026510469 (21h48m6.920219088s) [upload=19126]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 5.0779627s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
15.014087041s trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:46:02 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 15.014132107s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.001158964s trace:
https://jaeger.dev.storj.io/trace/ef75708e38a1e20
FAIL (2026-01-16 13:46:00 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001185043s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001267138s trace:
https://jaeger.dev.storj.io/trace/236ada71586f67bd
FAIL (2026-01-16 13:45:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001288159s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [...........................X.............X........X..X.XX...] duration:
4.670503657s trace:
https://jaeger.dev.storj.io/trace/287073b7bf0613bb
FAIL (2026-01-16 13:45:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
s=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512857569 (21h47m7.406566178s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512903297 (21h47m7.406611906s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513163702 (21h47m7.406872311s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513210451 (21h47m7.40691906s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513428296 (21h47m7.407136906s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513547533 (21h47m7.407256152s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513938307 (21h47m7.407646916s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514317599 (21h47m7.408026208s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514667566 (21h47m7.408376175s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:11.336233602 (21h47m8.229942212s) [upload=19126]: Next returned nil segment
Jan 16 13:43:11.336267347 (21h47m8.229975956s) [upload=19126]: Waiting for error group managing segments...
Jan 16 13:43:11.728156896 (21h47m8.621865516s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.744681339 (21h47m8.638389948s) [noise=true , address=81.171.14.70:4031 , piece_id=I2QFNTRNW5BSEW443K4HEMRPFWDWMS4A7OGLCBGL6MOBLBIVHXGA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.781770550 (21h47m8.675479159s) [noise=true , address=81.171.14.70:4039 , piece_id=PJJUDVG42DYTROSHW2EQ37F5KXADJDEJFE6WNHHZ756KVWQHOMMQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.060761834 (21h47m8.954470453s) [noise=true , address=185.167.204.205:4033 , piece_id=WYD6DRJKUXEGOYG2JKXTSPE6MGZ3PHAGTUKFAXXD5UZMOVDJPETQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066620951 (21h47m8.96032957s) [noise=true , address=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066990785 (21h47m8.960699404s) [noise=true , address=185.167.204.205:4031 , piece_id=7QWMBCQS2HLDT6LYENQCTPGQFCYSFHDBHZCEDCLTJ3XGYBEIEIUQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.067370788 (21h47m8.961079407s) [noise=true , address=185.167.204.205:4027 , piece_id=65HE6VZ67VQWRVZ52QTIOJR4YTZVEZHW4YXLTB3I3MMACX3QU5KQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.070378284 (21h47m8.964086903s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080751365 (21h47m8.974459984s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080916139 (21h47m8.974624748s) [noise=true , address=185.167.204.205:4023 , piece_id=SP3YCSO77HYXX3XHWPWZM4KZNESTVCVQN74T4X4AZHIMGSXHYCYQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.081172958 (21h47m8.974881567s) [noise=true , address=185.167.204.205:4019 , piece_id=MOY2FK2KGUGPPJ2IT5564P4O4Y72ELKITH43E76MQNK5WBF2ZI2A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.090478015 (21h47m8.984186624s) [noise=true , address=185.167.204.205:4013 , piece_id=CAJYKOAHLSKEAAM6BR3S4G24JB7CZYAQ2MSEJBRC4PYTPSTFZD5A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.095728263 (21h47m8.989436872s) [noise=true , address=185.167.204.206:4064 , piece_id=4MG2QWPMQD6BYDRJVCBPLMAYOECLVNG3YZJ6JPK6RDKXMWMXUEFA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.097262153 (21h47m8.990970763s) [noise=true , address=185.167.204.205:4034 , piece_id=GX5ZKXOND7HFY6QSA5H4BAOS343XACNZYU7CWY5LBY3TISMJBRBQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.099826616 (21h47m8.993535225s) [noise=true , address=185.167.204.206:4058 , piece_id=QLKSPOBUDDAPJK5R2EMJP74XM6TEBQLRSCBW2D4SUDYLAF5GAWZA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.111103288 (21h47m9.004811897s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.122116057 (21h47m9.015824666s) [noise=true , address=185.167.204.205:4002 , piece_id=IF42VMTKTFOZPV7MVZ6XEZA2VZQ4W7OB6GOU56AGM4V6UCICLKKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.126871291 (21h47m9.0205799s) [noise=true , address=185.167.204.205:4015 , piece_id=FILYFJPIFRGG7GWSPSWQY2IBXAJPFNOUWGCP234KANWQJD5XPZUA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.127756125 (21h47m9.021464734s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.131797441 (21h47m9.02550605s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.152285220 (21h47m9.045993839s) [noise=true , address=185.167.204.206:4054 , piece_id=OR36BJX2U7KWL3YGZDAMRNLC44IDHRD4FXVZDP4XDLVWA73YHCIA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.154173035 (21h47m9.047881644s) [noise=true , address=185.167.204.206:4057 , piece_id=WXMMXS66XDZLHNXKIR44R5Q54CLCQN77YMKOZ2RM7MPVTXT3M67A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.397697308 (21h47m9.291405927s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.847835054 (21h47m9.741543664s) [noise=true , address=89.149.201.147:4003 , piece_id=E72MB7PBJQUMJJLOEQC4FDZO6PEZW5S2I6UH46JDPQBS7CKGHTJQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:44:09.858617030 (21h48m6.752325639s) [noise=true , address=89.149.201.147:4001 , piece_id=RBW4Y52Y7K4UPKZ6J67HOW5VN75YUFIHFRUYZYE3Y2O6WPOTIYXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection
Jan 16 13:44:09.858698235 (21h48m6.752406864s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 188.166.225.170:49424->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858727541 (21h48m6.75243616s) [noise=true , address=89.149.201.147:4017 , piece_id=VOZD426Q4XUTLC7WBYGSQ54BS6VK4KP5TQMZ7R4SNYDRZXBEIW6A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection
Jan 16 13:44:09.858851426 (21h48m6.752560035s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:59878->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858875492 (21h48m6.752584101s) [seg_pos={0 0}, upload=19126]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Jan 16 13:44:10.026477265 (21h48m6.920185874s) [upload=19126]: Done uploading segments...
Jan 16 13:44:10.026510469 (21h48m6.920219088s) [upload=19126]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.670533255s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
25.414150888s trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:45:12 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 25.414175585s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXXXXXXXXXX] duration:
30.001181306s trace:
https://jaeger.dev.storj.io/trace/2e84880cc157dafc
FAIL (2026-01-16 13:45:09 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001211783s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [............................X.............X........X..X.XX..] duration:
4.786711894s trace:
https://jaeger.dev.storj.io/trace/287073b7bf0613bb
FAIL (2026-01-16 13:44:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
s=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512857569 (21h47m7.406566178s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512903297 (21h47m7.406611906s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513163702 (21h47m7.406872311s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513210451 (21h47m7.40691906s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513428296 (21h47m7.407136906s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513547533 (21h47m7.407256152s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513938307 (21h47m7.407646916s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514317599 (21h47m7.408026208s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514667566 (21h47m7.408376175s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:11.336233602 (21h47m8.229942212s) [upload=19126]: Next returned nil segment
Jan 16 13:43:11.336267347 (21h47m8.229975956s) [upload=19126]: Waiting for error group managing segments...
Jan 16 13:43:11.728156896 (21h47m8.621865516s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.744681339 (21h47m8.638389948s) [noise=true , address=81.171.14.70:4031 , piece_id=I2QFNTRNW5BSEW443K4HEMRPFWDWMS4A7OGLCBGL6MOBLBIVHXGA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.781770550 (21h47m8.675479159s) [noise=true , address=81.171.14.70:4039 , piece_id=PJJUDVG42DYTROSHW2EQ37F5KXADJDEJFE6WNHHZ756KVWQHOMMQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.060761834 (21h47m8.954470453s) [noise=true , address=185.167.204.205:4033 , piece_id=WYD6DRJKUXEGOYG2JKXTSPE6MGZ3PHAGTUKFAXXD5UZMOVDJPETQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066620951 (21h47m8.96032957s) [noise=true , address=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066990785 (21h47m8.960699404s) [noise=true , address=185.167.204.205:4031 , piece_id=7QWMBCQS2HLDT6LYENQCTPGQFCYSFHDBHZCEDCLTJ3XGYBEIEIUQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.067370788 (21h47m8.961079407s) [noise=true , address=185.167.204.205:4027 , piece_id=65HE6VZ67VQWRVZ52QTIOJR4YTZVEZHW4YXLTB3I3MMACX3QU5KQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.070378284 (21h47m8.964086903s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080751365 (21h47m8.974459984s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080916139 (21h47m8.974624748s) [noise=true , address=185.167.204.205:4023 , piece_id=SP3YCSO77HYXX3XHWPWZM4KZNESTVCVQN74T4X4AZHIMGSXHYCYQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.081172958 (21h47m8.974881567s) [noise=true , address=185.167.204.205:4019 , piece_id=MOY2FK2KGUGPPJ2IT5564P4O4Y72ELKITH43E76MQNK5WBF2ZI2A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.090478015 (21h47m8.984186624s) [noise=true , address=185.167.204.205:4013 , piece_id=CAJYKOAHLSKEAAM6BR3S4G24JB7CZYAQ2MSEJBRC4PYTPSTFZD5A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.095728263 (21h47m8.989436872s) [noise=true , address=185.167.204.206:4064 , piece_id=4MG2QWPMQD6BYDRJVCBPLMAYOECLVNG3YZJ6JPK6RDKXMWMXUEFA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.097262153 (21h47m8.990970763s) [noise=true , address=185.167.204.205:4034 , piece_id=GX5ZKXOND7HFY6QSA5H4BAOS343XACNZYU7CWY5LBY3TISMJBRBQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.099826616 (21h47m8.993535225s) [noise=true , address=185.167.204.206:4058 , piece_id=QLKSPOBUDDAPJK5R2EMJP74XM6TEBQLRSCBW2D4SUDYLAF5GAWZA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.111103288 (21h47m9.004811897s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.122116057 (21h47m9.015824666s) [noise=true , address=185.167.204.205:4002 , piece_id=IF42VMTKTFOZPV7MVZ6XEZA2VZQ4W7OB6GOU56AGM4V6UCICLKKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.126871291 (21h47m9.0205799s) [noise=true , address=185.167.204.205:4015 , piece_id=FILYFJPIFRGG7GWSPSWQY2IBXAJPFNOUWGCP234KANWQJD5XPZUA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.127756125 (21h47m9.021464734s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.131797441 (21h47m9.02550605s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.152285220 (21h47m9.045993839s) [noise=true , address=185.167.204.206:4054 , piece_id=OR36BJX2U7KWL3YGZDAMRNLC44IDHRD4FXVZDP4XDLVWA73YHCIA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.154173035 (21h47m9.047881644s) [noise=true , address=185.167.204.206:4057 , piece_id=WXMMXS66XDZLHNXKIR44R5Q54CLCQN77YMKOZ2RM7MPVTXT3M67A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.397697308 (21h47m9.291405927s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.847835054 (21h47m9.741543664s) [noise=true , address=89.149.201.147:4003 , piece_id=E72MB7PBJQUMJJLOEQC4FDZO6PEZW5S2I6UH46JDPQBS7CKGHTJQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:44:09.858617030 (21h48m6.752325639s) [noise=true , address=89.149.201.147:4001 , piece_id=RBW4Y52Y7K4UPKZ6J67HOW5VN75YUFIHFRUYZYE3Y2O6WPOTIYXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection
Jan 16 13:44:09.858698235 (21h48m6.752406864s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 188.166.225.170:49424->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858727541 (21h48m6.75243616s) [noise=true , address=89.149.201.147:4017 , piece_id=VOZD426Q4XUTLC7WBYGSQ54BS6VK4KP5TQMZ7R4SNYDRZXBEIW6A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection
Jan 16 13:44:09.858851426 (21h48m6.752560035s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:59878->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858875492 (21h48m6.752584101s) [seg_pos={0 0}, upload=19126]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Jan 16 13:44:10.026477265 (21h48m6.920185874s) [upload=19126]: Done uploading segments...
Jan 16 13:44:10.026510469 (21h48m6.920219088s) [upload=19126]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.786741379s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [.X..XX..X.............X.X............X.............X..X..X..] duration:
34.578621536s trace:
https://jaeger.dev.storj.io/trace/5475a631601811f5
FAIL (2026-01-16 13:44:53 UTC)
orbiter warning: context deadline exceeded
Duration: 34.578651182s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000844143s trace:
https://jaeger.dev.storj.io/trace/669426b8dd677181
FAIL (2026-01-16 13:44:48 UTC)
orbiter warning: context deadline exceeded
Duration: 5.00086419s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXXXXXXXXX] duration:
30.001625352s trace:
https://jaeger.dev.storj.io/trace/2c1eddc72c98f4f8
FAIL (2026-01-16 13:44:39 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001650729s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000996174s trace:
https://jaeger.dev.storj.io/trace/75163eefbdffc107
FAIL (2026-01-16 13:44:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001013236s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [.............................X.............X........X..X.XX.] duration:
5.23837711s trace:
https://jaeger.dev.storj.io/trace/287073b7bf0613bb
FAIL (2026-01-16 13:44:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
s=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512857569 (21h47m7.406566178s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512903297 (21h47m7.406611906s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513163702 (21h47m7.406872311s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513210451 (21h47m7.40691906s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513428296 (21h47m7.407136906s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513547533 (21h47m7.407256152s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513938307 (21h47m7.407646916s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514317599 (21h47m7.408026208s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514667566 (21h47m7.408376175s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:11.336233602 (21h47m8.229942212s) [upload=19126]: Next returned nil segment
Jan 16 13:43:11.336267347 (21h47m8.229975956s) [upload=19126]: Waiting for error group managing segments...
Jan 16 13:43:11.728156896 (21h47m8.621865516s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.744681339 (21h47m8.638389948s) [noise=true , address=81.171.14.70:4031 , piece_id=I2QFNTRNW5BSEW443K4HEMRPFWDWMS4A7OGLCBGL6MOBLBIVHXGA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.781770550 (21h47m8.675479159s) [noise=true , address=81.171.14.70:4039 , piece_id=PJJUDVG42DYTROSHW2EQ37F5KXADJDEJFE6WNHHZ756KVWQHOMMQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.060761834 (21h47m8.954470453s) [noise=true , address=185.167.204.205:4033 , piece_id=WYD6DRJKUXEGOYG2JKXTSPE6MGZ3PHAGTUKFAXXD5UZMOVDJPETQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066620951 (21h47m8.96032957s) [noise=true , address=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066990785 (21h47m8.960699404s) [noise=true , address=185.167.204.205:4031 , piece_id=7QWMBCQS2HLDT6LYENQCTPGQFCYSFHDBHZCEDCLTJ3XGYBEIEIUQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.067370788 (21h47m8.961079407s) [noise=true , address=185.167.204.205:4027 , piece_id=65HE6VZ67VQWRVZ52QTIOJR4YTZVEZHW4YXLTB3I3MMACX3QU5KQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.070378284 (21h47m8.964086903s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080751365 (21h47m8.974459984s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080916139 (21h47m8.974624748s) [noise=true , address=185.167.204.205:4023 , piece_id=SP3YCSO77HYXX3XHWPWZM4KZNESTVCVQN74T4X4AZHIMGSXHYCYQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.081172958 (21h47m8.974881567s) [noise=true , address=185.167.204.205:4019 , piece_id=MOY2FK2KGUGPPJ2IT5564P4O4Y72ELKITH43E76MQNK5WBF2ZI2A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.090478015 (21h47m8.984186624s) [noise=true , address=185.167.204.205:4013 , piece_id=CAJYKOAHLSKEAAM6BR3S4G24JB7CZYAQ2MSEJBRC4PYTPSTFZD5A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.095728263 (21h47m8.989436872s) [noise=true , address=185.167.204.206:4064 , piece_id=4MG2QWPMQD6BYDRJVCBPLMAYOECLVNG3YZJ6JPK6RDKXMWMXUEFA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.097262153 (21h47m8.990970763s) [noise=true , address=185.167.204.205:4034 , piece_id=GX5ZKXOND7HFY6QSA5H4BAOS343XACNZYU7CWY5LBY3TISMJBRBQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.099826616 (21h47m8.993535225s) [noise=true , address=185.167.204.206:4058 , piece_id=QLKSPOBUDDAPJK5R2EMJP74XM6TEBQLRSCBW2D4SUDYLAF5GAWZA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.111103288 (21h47m9.004811897s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.122116057 (21h47m9.015824666s) [noise=true , address=185.167.204.205:4002 , piece_id=IF42VMTKTFOZPV7MVZ6XEZA2VZQ4W7OB6GOU56AGM4V6UCICLKKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.126871291 (21h47m9.0205799s) [noise=true , address=185.167.204.205:4015 , piece_id=FILYFJPIFRGG7GWSPSWQY2IBXAJPFNOUWGCP234KANWQJD5XPZUA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.127756125 (21h47m9.021464734s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.131797441 (21h47m9.02550605s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.152285220 (21h47m9.045993839s) [noise=true , address=185.167.204.206:4054 , piece_id=OR36BJX2U7KWL3YGZDAMRNLC44IDHRD4FXVZDP4XDLVWA73YHCIA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.154173035 (21h47m9.047881644s) [noise=true , address=185.167.204.206:4057 , piece_id=WXMMXS66XDZLHNXKIR44R5Q54CLCQN77YMKOZ2RM7MPVTXT3M67A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.397697308 (21h47m9.291405927s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.847835054 (21h47m9.741543664s) [noise=true , address=89.149.201.147:4003 , piece_id=E72MB7PBJQUMJJLOEQC4FDZO6PEZW5S2I6UH46JDPQBS7CKGHTJQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:44:09.858617030 (21h48m6.752325639s) [noise=true , address=89.149.201.147:4001 , piece_id=RBW4Y52Y7K4UPKZ6J67HOW5VN75YUFIHFRUYZYE3Y2O6WPOTIYXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection
Jan 16 13:44:09.858698235 (21h48m6.752406864s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 188.166.225.170:49424->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858727541 (21h48m6.75243616s) [noise=true , address=89.149.201.147:4017 , piece_id=VOZD426Q4XUTLC7WBYGSQ54BS6VK4KP5TQMZ7R4SNYDRZXBEIW6A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection
Jan 16 13:44:09.858851426 (21h48m6.752560035s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:59878->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858875492 (21h48m6.752584101s) [seg_pos={0 0}, upload=19126]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Jan 16 13:44:10.026477265 (21h48m6.920185874s) [upload=19126]: Done uploading segments...
Jan 16 13:44:10.026510469 (21h48m6.920219088s) [upload=19126]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 5.238392699s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [..............................X.............X........X..X.XX] duration:
1m0.170667311s trace:
https://jaeger.dev.storj.io/trace/287073b7bf0613bb
FAIL (2026-01-16 13:44:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
s=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512857569 (21h47m7.406566178s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.512903297 (21h47m7.406611906s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513163702 (21h47m7.406872311s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513210451 (21h47m7.40691906s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513428296 (21h47m7.407136906s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513547533 (21h47m7.407256152s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.513938307 (21h47m7.407646916s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514317599 (21h47m7.408026208s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:10.514667566 (21h47m7.408376175s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Uploading piece...
Jan 16 13:43:11.336233602 (21h47m8.229942212s) [upload=19126]: Next returned nil segment
Jan 16 13:43:11.336267347 (21h47m8.229975956s) [upload=19126]: Waiting for error group managing segments...
Jan 16 13:43:11.728156896 (21h47m8.621865516s) [noise=true , address=81.171.14.70:4030 , piece_id=QIICEONDSHSCEMSRFAVH4XKXK3EOUPPRFWGGJD5RB3JIMGE7JRLQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.744681339 (21h47m8.638389948s) [noise=true , address=81.171.14.70:4031 , piece_id=I2QFNTRNW5BSEW443K4HEMRPFWDWMS4A7OGLCBGL6MOBLBIVHXGA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:11.781770550 (21h47m8.675479159s) [noise=true , address=81.171.14.70:4039 , piece_id=PJJUDVG42DYTROSHW2EQ37F5KXADJDEJFE6WNHHZ756KVWQHOMMQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.060761834 (21h47m8.954470453s) [noise=true , address=185.167.204.205:4033 , piece_id=WYD6DRJKUXEGOYG2JKXTSPE6MGZ3PHAGTUKFAXXD5UZMOVDJPETQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066620951 (21h47m8.96032957s) [noise=true , address=185.167.204.205:4026 , piece_id=AIWA5MU2M7I5DLQJXA7UU7KBTGA4BU7EA3QIVWA45AEXIE6CZSCA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.066990785 (21h47m8.960699404s) [noise=true , address=185.167.204.205:4031 , piece_id=7QWMBCQS2HLDT6LYENQCTPGQFCYSFHDBHZCEDCLTJ3XGYBEIEIUQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.067370788 (21h47m8.961079407s) [noise=true , address=185.167.204.205:4027 , piece_id=65HE6VZ67VQWRVZ52QTIOJR4YTZVEZHW4YXLTB3I3MMACX3QU5KQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.070378284 (21h47m8.964086903s) [noise=true , address=185.167.204.206:4051 , piece_id=Z43RVXK5I6WZLKADZ22KVOFENVIUXMQYR7PB56BTXSW4UJ3L25ZQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080751365 (21h47m8.974459984s) [noise=true , address=185.167.204.205:4001 , piece_id=UZ2AG2JPLZ4Q326UYYZZ773DKYPMUIA6EHG54TMFGY3JM6HM4FXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.080916139 (21h47m8.974624748s) [noise=true , address=185.167.204.205:4023 , piece_id=SP3YCSO77HYXX3XHWPWZM4KZNESTVCVQN74T4X4AZHIMGSXHYCYQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.081172958 (21h47m8.974881567s) [noise=true , address=185.167.204.205:4019 , piece_id=MOY2FK2KGUGPPJ2IT5564P4O4Y72ELKITH43E76MQNK5WBF2ZI2A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.090478015 (21h47m8.984186624s) [noise=true , address=185.167.204.205:4013 , piece_id=CAJYKOAHLSKEAAM6BR3S4G24JB7CZYAQ2MSEJBRC4PYTPSTFZD5A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.095728263 (21h47m8.989436872s) [noise=true , address=185.167.204.206:4064 , piece_id=4MG2QWPMQD6BYDRJVCBPLMAYOECLVNG3YZJ6JPK6RDKXMWMXUEFA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.097262153 (21h47m8.990970763s) [noise=true , address=185.167.204.205:4034 , piece_id=GX5ZKXOND7HFY6QSA5H4BAOS343XACNZYU7CWY5LBY3TISMJBRBQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.099826616 (21h47m8.993535225s) [noise=true , address=185.167.204.206:4058 , piece_id=QLKSPOBUDDAPJK5R2EMJP74XM6TEBQLRSCBW2D4SUDYLAF5GAWZA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.111103288 (21h47m9.004811897s) [noise=true , address=185.167.204.205:4020 , piece_id=NECEB5MJ53GJZ2EDNOEZFCVXDVAYY2BOK2YTHCEMFLTWYQWLZF3A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.122116057 (21h47m9.015824666s) [noise=true , address=185.167.204.205:4002 , piece_id=IF42VMTKTFOZPV7MVZ6XEZA2VZQ4W7OB6GOU56AGM4V6UCICLKKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.126871291 (21h47m9.0205799s) [noise=true , address=185.167.204.205:4015 , piece_id=FILYFJPIFRGG7GWSPSWQY2IBXAJPFNOUWGCP234KANWQJD5XPZUA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.127756125 (21h47m9.021464734s) [noise=true , address=185.167.204.206:4050 , piece_id=UCYS2IFO3GP4RSIHQR3Z2JNZIA4VOQ6UJ7HT2VUIDJQCMTDISCKA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.131797441 (21h47m9.02550605s) [noise=true , address=185.167.204.206:4048 , piece_id=RV4N243X4LDIL7TM7QWT5HC2OTYI5Y6GNU4JSFMNEA2FBDUTM5RQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.152285220 (21h47m9.045993839s) [noise=true , address=185.167.204.206:4054 , piece_id=OR36BJX2U7KWL3YGZDAMRNLC44IDHRD4FXVZDP4XDLVWA73YHCIA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.154173035 (21h47m9.047881644s) [noise=true , address=185.167.204.206:4057 , piece_id=WXMMXS66XDZLHNXKIR44R5Q54CLCQN77YMKOZ2RM7MPVTXT3M67A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.397697308 (21h47m9.291405927s) [noise=true , address=89.149.201.147:4023 , piece_id=JXESVMEYDTWWMYZ6JEDOQYYX5KQ4DJH7XLEXF5HB25QBPKSGBWTQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:43:12.847835054 (21h47m9.741543664s) [noise=true , address=89.149.201.147:4003 , piece_id=E72MB7PBJQUMJJLOEQC4FDZO6PEZW5S2I6UH46JDPQBS7CKGHTJQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: <nil>
Jan 16 13:44:09.858617030 (21h48m6.752325639s) [noise=true , address=89.149.201.147:4001 , piece_id=RBW4Y52Y7K4UPKZ6J67HOW5VN75YUFIHFRUYZYE3Y2O6WPOTIYXA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40250->89.149.201.147:4001: use of closed network connection
Jan 16 13:44:09.858698235 (21h48m6.752406864s) [noise=true , address=89.149.201.147:4022 , piece_id=6S5IHAI447N64RYXL2C6HRTQOUOPXST2DSVCWN53OMT7ZA3CIFXQ, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 188.166.225.170:49424->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858727541 (21h48m6.75243616s) [noise=true , address=89.149.201.147:4017 , piece_id=VOZD426Q4XUTLC7WBYGSQ54BS6VK4KP5TQMZ7R4SNYDRZXBEIW6A, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40586->89.149.201.147:4017: use of closed network connection
Jan 16 13:44:09.858851426 (21h48m6.752560035s) [noise=true , address=89.149.201.147:4005 , piece_id=K2PZNU2J42JAGPFZMRZFIKXN4UUXYKLGEKTDUWT2XWCJCVXEUQNA, seg_pos={0 0}, upload=19126]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 188.166.225.170:59878->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 13:44:09.858875492 (21h48m6.752584101s) [seg_pos={0 0}, upload=19126]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Jan 16 13:44:10.026477265 (21h48m6.920185874s) [upload=19126]: Done uploading segments...
Jan 16 13:44:10.026510469 (21h48m6.920219088s) [upload=19126]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 1m0.170691237s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000549972s trace:
https://jaeger.dev.storj.io/trace/6ed5feb611d83407
FAIL (2026-01-16 13:43:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000570322s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
22.840307075s trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:43:59 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 22.840329068s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXXXXXXXX] duration:
30.001157059s trace:
https://jaeger.dev.storj.io/trace/31ff1fb25059e322
FAIL (2026-01-16 13:43:55 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001207053s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [..X..XX..X.............X.X............X.............X..X..X.] duration:
16.3805226s trace:
https://jaeger.dev.storj.io/trace/5475a631601811f5
FAIL (2026-01-16 13:43:45 UTC)
orbiter warning: context deadline exceeded
Duration: 16.380553848s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [...X..XX..X.............X.X............X.............X..X..X] duration:
1m0.001372345s trace:
https://jaeger.dev.storj.io/trace/5475a631601811f5
FAIL (2026-01-16 13:43:27 UTC)
orbiter warning: context deadline exceeded
Duration: 1m0.001398084s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001233226s trace:
https://jaeger.dev.storj.io/trace/3e960cae8a809553
FAIL (2026-01-16 13:43:20 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001254525s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXXXXXXX] duration:
30.001284622s trace:
https://jaeger.dev.storj.io/trace/6d1fd4f43733ea63
FAIL (2026-01-16 13:43:12 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001294902s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [...............................X.............X........X..X.X] duration:
1m0.183571874s trace:
https://jaeger.dev.storj.io/trace/62f19fcc18b9343
FAIL (2026-01-16 13:43:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
, upload=19111]: Uploading piece...
Jan 16 13:42:02.686684792 (21h45m59.580393401s) [noise=true , address=81.171.14.70:4044 , piece_id=3UHHYBT2D4RQ3736IX2DTDN3KM6JXQWOBJYNH57EH76GKSEVQCNA, seg_pos={0 0}, upload=19111]: Uploading piece...
Jan 16 13:42:02.688262016 (21h45m59.581970625s) [noise=true , address=89.149.201.147:4020 , piece_id=DLXIRI6U3Y7MGXADVWTVQVZGZ6BMPIAVIOBXEQP6H6EJ6UDU2TFA, seg_pos={0 0}, upload=19111]: Uploading piece...
Jan 16 13:42:02.688779630 (21h45m59.582488249s) [noise=true , address=185.167.204.205:4017 , piece_id=474ORPAWOUHHZAN3TONWSQKV5YAAEIYAFTAMUQNW3X2NSY2TU5SQ, seg_pos={0 0}, upload=19111]: Uploading piece...
Jan 16 13:42:02.690924004 (21h45m59.584632623s) [noise=true , address=89.149.201.147:4010 , piece_id=SGIMLB7F5FIRBQDEB527TX576LJMY2KVHTTTNULKQR474HH4T2GA, seg_pos={0 0}, upload=19111]: Uploading piece...
Jan 16 13:42:02.696477528 (21h45m59.590186157s) [noise=true , address=81.171.14.70:4026 , piece_id=2WAIRRNXSQQDNJY4H6PLXQLTJ6SDVF2ZZYNIX55GV4DDYVMYXIPQ, seg_pos={0 0}, upload=19111]: Uploading piece...
Jan 16 13:42:02.698587716 (21h45m59.592296335s) [noise=true , address=185.167.204.206:4054 , piece_id=GY3VZMZZBLUKSCQWWLH3TC5APDUFV2YS7JXFGL3XRLDT7KH3G2EA, seg_pos={0 0}, upload=19111]: Uploading piece...
Jan 16 13:42:03.526345432 (21h46m0.420054051s) [upload=19111]: Next returned nil segment
Jan 16 13:42:03.526362966 (21h46m0.420071575s) [upload=19111]: Waiting for error group managing segments...
Jan 16 13:42:03.925227165 (21h46m0.818935784s) [noise=true , address=81.171.14.70:4042 , piece_id=KVITZDKM6NCJM6WMSLIPSP5NKWNPRGQWDUQ2Q7VXRTHIWU5NDLRA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:03.934575625 (21h46m0.828284234s) [noise=true , address=81.171.14.70:4033 , piece_id=P44HP4DUHDFB4EGCRPXLLW2LF4O4FCMMFWX5YI5LO4MZG5LZTWWQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:03.978554353 (21h46m0.872262972s) [noise=true , address=81.171.14.70:4026 , piece_id=2WAIRRNXSQQDNJY4H6PLXQLTJ6SDVF2ZZYNIX55GV4DDYVMYXIPQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.249394588 (21h46m1.143103207s) [noise=true , address=185.167.204.205:4017 , piece_id=474ORPAWOUHHZAN3TONWSQKV5YAAEIYAFTAMUQNW3X2NSY2TU5SQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.249437750 (21h46m1.143146379s) [noise=true , address=185.167.204.205:4009 , piece_id=77DCRRFEIKTTL4NKCVNV4ZM27NBXHSTKJFOLZRFL6DJCIL65WGFA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.257403747 (21h46m1.151112366s) [noise=true , address=185.167.204.205:4007 , piece_id=QD2UVWDZF7UCLTW3PULRYYMQQQ4RPGI55JY2BSXCEBAD354QPRIA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.262170584 (21h46m1.155879203s) [noise=true , address=185.167.204.206:4055 , piece_id=MLHO4POEOVNSTLBRBFPF3QO76VTKQGAITBTJLJ4LF4WEK3M3SUVQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.266296951 (21h46m1.16000557s) [noise=true , address=185.167.204.206:4048 , piece_id=MG4GR3K5LFTM2BPKF2B7XZZCS653J4SPO6WJKRLCJY4PI47BEW5Q, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.266842870 (21h46m1.160551489s) [noise=true , address=185.167.204.206:4054 , piece_id=GY3VZMZZBLUKSCQWWLH3TC5APDUFV2YS7JXFGL3XRLDT7KH3G2EA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.271245102 (21h46m1.164953711s) [noise=true , address=185.167.204.205:4015 , piece_id=ULL4GZAJYPCZHUQBYIRKI3MZUTRZ6ZOZAKYAZEMWSXQ4BOWNUO2A, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.336011581 (21h46m1.2297202s) [noise=true , address=185.167.204.205:4028 , piece_id=FRMVIU7EAFLA3YJS5A3VZEK5MPTGGEFVB32QXPJIVKSUYXXOFLLQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.349187248 (21h46m1.242895867s) [noise=true , address=185.167.204.205:4023 , piece_id=U6SWCKGJC2AVH7GB3WMYWJ4HCQYWDP2BLL6NCUYUNLYKGXVRRKJA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.350360613 (21h46m1.244069232s) [noise=true , address=185.167.204.206:4064 , piece_id=CARWYK4Y6GJFZHNBKZM2GCUPSEY2XDMFCHE2TYYCRRHE4KFLN2PA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.353705060 (21h46m1.247413689s) [noise=true , address=185.167.204.206:4056 , piece_id=L3H6XIJPOLHPXHLTYWG5RODX5J6MA6V46J7CBMZ53ZQOS66UB53A, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.353831321 (21h46m1.24753994s) [noise=true , address=185.167.204.206:4041 , piece_id=4Y64OWHDMUTXPSIR2IYGAKT72HCSLMYS6CA3TNFMMM3TVGI5S77Q, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.360596012 (21h46m1.254304631s) [noise=true , address=185.167.204.206:4065 , piece_id=U4EKEDIYU7JVPORBQBLC3DDFKM6FUCVFF6TPYBNHXDBBMUAPC7SA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.365432130 (21h46m1.259140749s) [noise=true , address=185.167.204.205:4027 , piece_id=RE634OM33SELIEDVPVOPROPAYM25W6YSXC2XDKZDNCNQ4XANSFJA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.400874835 (21h46m1.294583454s) [noise=true , address=81.171.14.70:4041 , piece_id=TLF24VJZU6YDYYO6SWMRHO2FLS3HQ4K4X6YEZJSQFEHBXFYBS3XQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.410444977 (21h46m1.304153596s) [noise=true , address=81.171.14.70:4032 , piece_id=2D36QS7EAVYLB4TKYQ65Q5X4PC546VL3RX6J7YVKAKBTON3RIZNQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.473224473 (21h46m1.366933102s) [noise=true , address=81.171.14.70:4044 , piece_id=3UHHYBT2D4RQ3736IX2DTDN3KM6JXQWOBJYNH57EH76GKSEVQCNA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.502069014 (21h46m1.395777633s) [noise=true , address=81.171.14.70:4048 , piece_id=UEADOQQPCQJR3LHEFISVZ6ET5U7O5U2P5ISHCLUQQKDK7644CACQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:04.606735134 (21h46m1.500443753s) [noise=true , address=89.149.201.147:4001 , piece_id=SYSTA7UBTS5UVJ7KNCOVJE5JAWN5S33MNNTIFODVWRQZG6ZWUMIQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:42:05.128261839 (21h46m2.021970448s) [noise=true , address=89.149.201.147:4014 , piece_id=MFIFOHDYFJZMMPXT2IWI2ZDKCO4JI4J3VSQKMVQI6S5FBTRLPQQA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: <nil>
Jan 16 13:43:02.012333643 (21h46m58.906042272s) [noise=true , address=89.149.201.147:4013 , piece_id=TRQUQ3W3KGXR65N7PJK5EH6SH2CHN4HSRVV4KSROX4OMNESPRUCQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 188.166.225.170:49790->89.149.201.147:4013: use of closed network connection; write tcp 188.166.225.170:49790->89.149.201.147:4013: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49790->89.149.201.147:4013: use of closed network connection
Jan 16 13:43:02.012455264 (21h46m58.906163883s) [noise=true , address=89.149.201.147:4011 , piece_id=6C4557ZACM54XLKH7GLW5QUY4RV74WRCFPR2NR76RGQRESJWYAEQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:54122->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:54122->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54122->89.149.201.147:4011: use of closed network connection
Jan 16 13:43:02.012565894 (21h46m58.906274503s) [noise=true , address=89.149.201.147:4012 , piece_id=S3Q2Z5QIGMJ5XHYFWPEGH2KPHJ46CEVARCZ6SCTPFRLLVRPPNYHQ, seg_pos={0 0}, upload=19111]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: write tcp 188.166.225.170:51016->89.149.201.147:4012: use of closed network connection; write tcp 188.166.225.170:51016->89.149.201.147:4012: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51016->89.149.201.147:4012: use of closed network connection
Jan 16 13:43:02.012688478 (21h46m58.906397097s) [noise=true , address=89.149.201.147:4020 , piece_id=DLXIRI6U3Y7MGXADVWTVQVZGZ6BMPIAVIOBXEQP6H6EJ6UDU2TFA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: write tcp 188.166.225.170:57122->89.149.201.147:4020: use of closed network connection; write tcp 188.166.225.170:57122->89.149.201.147:4020: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57122->89.149.201.147:4020: use of closed network connection
Jan 16 13:43:02.012791244 (21h46m58.906499863s) [noise=true , address=89.149.201.147:4010 , piece_id=SGIMLB7F5FIRBQDEB527TX576LJMY2KVHTTTNULKQR474HH4T2GA, seg_pos={0 0}, upload=19111]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 188.166.225.170:48236->89.149.201.147:4010: use of closed network connection; write tcp 188.166.225.170:48236->89.149.201.147:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48236->89.149.201.147:4010: use of closed network connection
Jan 16 13:43:02.012816462 (21h46m58.906525071s) [seg_pos={0 0}, upload=19111]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 16 13:43:02.192795873 (21h46m59.086504492s) [upload=19111]: Done uploading segments...
Jan 16 13:43:02.192832593 (21h46m59.086541202s) [upload=19111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 1m0.183599105s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
11.169736174s trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:42:49 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 11.169763255s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXXXXXX] duration:
30.001215491s trace:
https://jaeger.dev.storj.io/trace/d7f5aea83976b72
FAIL (2026-01-16 13:42:42 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001242421s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
10.954133765s trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:42:23 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 10.954160607s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [....X..XX..X.............X.X............X.............X..X..] duration:
28.465070375s trace:
https://jaeger.dev.storj.io/trace/5439297ea6060594
FAIL (2026-01-16 13:42:17 UTC)
orbiter warning: context deadline exceeded
Duration: 28.465096494s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001598531s trace:
https://jaeger.dev.storj.io/trace/3f19e32f6e287bee
FAIL (2026-01-16 13:42:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001621864s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
9.100247904s trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:41:59 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 9.100276749s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXXXXX] duration:
30.00119918s trace:
https://jaeger.dev.storj.io/trace/149b72d7da25b53a
FAIL (2026-01-16 13:41:38 UTC)
orbiter warning: context deadline exceeded
Duration: 30.00122534s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [.....X..XX..X.............X.X............X.............X..X.] duration:
34.051668268s trace:
https://jaeger.dev.storj.io/trace/5439297ea6060594
FAIL (2026-01-16 13:41:37 UTC)
orbiter warning: context deadline exceeded
Duration: 34.051682183s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
15.28826931s trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:41:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 15.288297144s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.001624549s trace:
https://jaeger.dev.storj.io/trace/2d2fb6f3a2cd0572
FAIL (2026-01-16 13:41:08 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001647814s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [X.....X..XX..X.............X.X............X.............X..X] duration:
1m0.001189869s trace:
https://jaeger.dev.storj.io/trace/5439297ea6060594
FAIL (2026-01-16 13:41:03 UTC)
orbiter warning: context deadline exceeded
Duration: 1m0.001271865s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................................X.............X........X..X.] duration:
4.881038977s trace:
https://jaeger.dev.storj.io/trace/27fb37ef42045750
FAIL (2026-01-16 13:40:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
g piece...
Jan 16 13:39:46.139819733 (21h43m43.033528342s) [noise=true , address=81.171.14.70:4033 , piece_id=XVRTU7IMLJEIQ7WXOVWCDNZAQF2DRRHSGKY6X7FBLT5CP2RECF3Q, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.140154921 (21h43m43.03386353s) [noise=true , address=185.167.204.205:4033 , piece_id=M4JYVQMSWRO53S6PCMX4KGGTGLBA3BCW4N6XE4DZD4KCQX47NLAQ, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.140456234 (21h43m43.034164843s) [noise=true , address=81.171.14.70:4036 , piece_id=QN7B2DUYMWPRNOAMSNS6RHBNALHTD2DOINIHB4LCT3YIBGZZGJVQ, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.140829846 (21h43m43.034538455s) [noise=true , address=81.171.14.70:4026 , piece_id=Q3ATGEPXQILOU3TB7T26LXLAAYYNMYHGMOS3AR5MZ4TA3B2WQAFA, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.141254545 (21h43m43.034963164s) [noise=true , address=81.171.14.70:4035 , piece_id=RD4LZUJBPGZWV6OXUWOWBNPSLPX5WMSELBOGN2IY6OY34ND2A2HA, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.141768914 (21h43m43.035477714s) [noise=true , address=185.167.204.206:4038 , piece_id=PXUPUYISL7ULMJYZFPAHY5V65XUVO6M6UOGEI2XLXWWNUP5VWZ2Q, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.142301408 (21h43m43.036010017s) [noise=true , address=89.149.201.147:4002 , piece_id=43XQFG5DGSMH4EA7BICXWRAFMSBHW2OK2PIYQGNRJ5XG23YTQ7RQ, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.142718061 (21h43m43.03642668s) [noise=true , address=185.167.204.205:4017 , piece_id=S3IEI2AKX7TWBUPQZ7CHQEA4S3CKRQOE24J42JNIXRO6DEHB6XFA, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.143181153 (21h43m43.036889772s) [noise=true , address=185.167.204.206:4048 , piece_id=7R655HVH2N6SRLQKHDXUV4SUIJIBUV74XQR2EQPGAHYRPQV4KHSA, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.143548833 (21h43m43.037257442s) [noise=true , address=81.171.14.70:4042 , piece_id=RTNRKUNG5DNPSCMYG6HI3QXMYIHRXBNVGOXFWWQYUOADGAWCSIUA, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.969931622 (21h43m43.863640231s) [upload=19080]: Next returned nil segment
Jan 16 13:39:46.969942612 (21h43m43.863651221s) [upload=19080]: Waiting for error group managing segments...
Jan 16 13:39:47.358574118 (21h43m44.252282727s) [noise=true , address=81.171.14.70:4041 , piece_id=S6WMUOPW77XUJ3XU4OR5CN77VSYXBVKRQ3XTOOIHCIPWMR5UNFZA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.376906154 (21h43m44.270614763s) [noise=true , address=81.171.14.70:4036 , piece_id=QN7B2DUYMWPRNOAMSNS6RHBNALHTD2DOINIHB4LCT3YIBGZZGJVQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.386359813 (21h43m44.280068422s) [noise=true , address=81.171.14.70:4026 , piece_id=Q3ATGEPXQILOU3TB7T26LXLAAYYNMYHGMOS3AR5MZ4TA3B2WQAFA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.391293989 (21h43m44.285002608s) [noise=true , address=81.171.14.70:4040 , piece_id=N4BPXSNU7N6YGS4DB5OKQABXHTMGZJ5H5MF3TLNEMH66IVPF6OIQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.393020717 (21h43m44.286729326s) [noise=true , address=81.171.14.70:4042 , piece_id=RTNRKUNG5DNPSCMYG6HI3QXMYIHRXBNVGOXFWWQYUOADGAWCSIUA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.396217273 (21h43m44.289925892s) [noise=true , address=81.171.14.70:4037 , piece_id=IERG62NVFXDMM27B2DSSAF43HNKB6KL2BHPPLCXSV7SLZEX22Q2Q, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.704387476 (21h43m44.598096085s) [noise=true , address=185.167.204.206:4037 , piece_id=NFEZPWZSFICRZXJ46AZNEQNDKNONUBHK7EDCAKKH5AOK6DFQJZGA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.710467703 (21h43m44.604176312s) [noise=true , address=185.167.204.205:4035 , piece_id=QM4RJK2NJNLLEQB5BVN5AAA4I4QVRGE6JDEFD672S3K5XWFCNQBA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.721346577 (21h43m44.615055186s) [noise=true , address=185.167.204.206:4070 , piece_id=A6GCO6YYOWVWUJZC3CP33EMCNZ7DDJ4QFFBZWYD7PRXTM2AKLHPA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.729385904 (21h43m44.623094523s) [noise=true , address=185.167.204.205:4005 , piece_id=YKRCQYAVVVEKUVJSSWZ6BVF2N2XV2YKACR6TPV3GOQJBGCYPQ4UA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.735337757 (21h43m44.629046376s) [noise=true , address=185.167.204.205:4022 , piece_id=2733QI27ZFIEQKE6QJSYHUJVPSA3LIPZFRV5TTIQYWBNQ2OCVSPQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.740889047 (21h43m44.634597656s) [noise=true , address=185.167.204.206:4038 , piece_id=PXUPUYISL7ULMJYZFPAHY5V65XUVO6M6UOGEI2XLXWWNUP5VWZ2Q, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.755655654 (21h43m44.649364263s) [noise=true , address=185.167.204.205:4033 , piece_id=M4JYVQMSWRO53S6PCMX4KGGTGLBA3BCW4N6XE4DZD4KCQX47NLAQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.755687955 (21h43m44.649396564s) [noise=true , address=185.167.204.205:4013 , piece_id=VRMIYOM6WXTUEZXLJ7NZ2BIMPQ267N5J5GVCIEYGKNMHDGRS66XA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.759144076 (21h43m44.652852695s) [noise=true , address=185.167.204.205:4017 , piece_id=S3IEI2AKX7TWBUPQZ7CHQEA4S3CKRQOE24J42JNIXRO6DEHB6XFA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.761003757 (21h43m44.654712366s) [noise=true , address=185.167.204.205:4031 , piece_id=I5KIDXMMQMW4QBYMTRS7W43R54IWCXCY5BDIRR3HYMYEN47JORPQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.763654645 (21h43m44.657363254s) [noise=true , address=185.167.204.205:4007 , piece_id=7MPVUTH73EH5OPTERTJDMLQV7JHZ4XUHCA72XVWUDCUYCGDMCUWA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.772137476 (21h43m44.665846095s) [noise=true , address=185.167.204.206:4048 , piece_id=7R655HVH2N6SRLQKHDXUV4SUIJIBUV74XQR2EQPGAHYRPQV4KHSA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.844490289 (21h43m44.738198908s) [noise=true , address=81.171.14.70:4033 , piece_id=XVRTU7IMLJEIQ7WXOVWCDNZAQF2DRRHSGKY6X7FBLT5CP2RECF3Q, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.874238622 (21h43m44.767947231s) [noise=true , address=81.171.14.70:4035 , piece_id=RD4LZUJBPGZWV6OXUWOWBNPSLPX5WMSELBOGN2IY6OY34ND2A2HA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.876778518 (21h43m44.770487147s) [noise=true , address=81.171.14.70:4039 , piece_id=V6M3UTW2SCOEV3RG4LQEFOYGHSZ24LR23I454SLLNLRWSZJWH4AA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:48.033734761 (21h43m44.92744337s) [noise=true , address=89.149.201.147:4002 , piece_id=43XQFG5DGSMH4EA7BICXWRAFMSBHW2OK2PIYQGNRJ5XG23YTQ7RQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:48.044893469 (21h43m44.938602078s) [noise=true , address=89.149.201.147:4024 , piece_id=A6AMM64QICJBFRDVCVRKK574L4NCT22ESOVAFGRS3I3OZWHC4RAQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:48.054007682 (21h43m44.947716291s) [noise=true , address=89.149.201.147:4018 , piece_id=ED5N6V45S2Z6H7M5GVIABLFQNXEYYCCTVPUO4EDLKO5FFXSHXHPQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:48.139825555 (21h43m45.033534164s) [noise=true , address=89.149.201.147:4009 , piece_id=BWSDC25ATTGK32IIKZBQYTJFYTQPNBDWEZUOPY6SMWK5AEX2O3KQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:40:45.486720649 (21h44m42.380429268s) [noise=true , address=89.149.201.147:4014 , piece_id=4AMYLKAQKIINVU76QNAGUH7W3RGPII2CJD4NCDS3Q3LN7RADPBIQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 188.166.225.170:50946->89.149.201.147:4014: use of closed network connection; write tcp 188.166.225.170:50946->89.149.201.147:4014: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50946->89.149.201.147:4014: use of closed network connection
Jan 16 13:40:45.486902295 (21h44m42.380610924s) [noise=true , address=89.149.201.147:4007 , piece_id=DOPWPQ4XFQAWCHSOF3BSVWERB62J2RUW5GQHPLNIS7R53KTDDDEQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:37326->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:37326->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37326->89.149.201.147:4007: use of closed network connection
Jan 16 13:40:45.487013636 (21h44m42.380722255s) [noise=true , address=89.149.201.147:4019 , piece_id=QOGUAPCIS2XZPEMAJKXF764MRX6G6MRMQDRU3COCSWCBFOCDQI4A, seg_pos={0 0}, upload=19080]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: write tcp 188.166.225.170:48924->89.149.201.147:4019: use of closed network connection; write tcp 188.166.225.170:48924->89.149.201.147:4019: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48924->89.149.201.147:4019: use of closed network connection
Jan 16 13:40:45.487057010 (21h44m42.380765619s) [seg_pos={0 0}, upload=19080]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 16 13:40:45.651521990 (21h44m42.545230599s) [upload=19080]: Done uploading segments...
Jan 16 13:40:45.651556576 (21h44m42.545265195s) [upload=19080]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.881092769s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXXXX] duration:
30.001359004s trace:
https://jaeger.dev.storj.io/trace/b4eb21dbaa5d920
FAIL (2026-01-16 13:40:57 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001379983s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000999028s trace:
https://jaeger.dev.storj.io/trace/2f3e0d338aa67feb
FAIL (2026-01-16 13:40:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001020319s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................................X.............X........X..X] duration:
1m0.167338214s trace:
https://jaeger.dev.storj.io/trace/27fb37ef42045750
FAIL (2026-01-16 13:40:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
g piece...
Jan 16 13:39:46.139819733 (21h43m43.033528342s) [noise=true , address=81.171.14.70:4033 , piece_id=XVRTU7IMLJEIQ7WXOVWCDNZAQF2DRRHSGKY6X7FBLT5CP2RECF3Q, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.140154921 (21h43m43.03386353s) [noise=true , address=185.167.204.205:4033 , piece_id=M4JYVQMSWRO53S6PCMX4KGGTGLBA3BCW4N6XE4DZD4KCQX47NLAQ, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.140456234 (21h43m43.034164843s) [noise=true , address=81.171.14.70:4036 , piece_id=QN7B2DUYMWPRNOAMSNS6RHBNALHTD2DOINIHB4LCT3YIBGZZGJVQ, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.140829846 (21h43m43.034538455s) [noise=true , address=81.171.14.70:4026 , piece_id=Q3ATGEPXQILOU3TB7T26LXLAAYYNMYHGMOS3AR5MZ4TA3B2WQAFA, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.141254545 (21h43m43.034963164s) [noise=true , address=81.171.14.70:4035 , piece_id=RD4LZUJBPGZWV6OXUWOWBNPSLPX5WMSELBOGN2IY6OY34ND2A2HA, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.141768914 (21h43m43.035477714s) [noise=true , address=185.167.204.206:4038 , piece_id=PXUPUYISL7ULMJYZFPAHY5V65XUVO6M6UOGEI2XLXWWNUP5VWZ2Q, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.142301408 (21h43m43.036010017s) [noise=true , address=89.149.201.147:4002 , piece_id=43XQFG5DGSMH4EA7BICXWRAFMSBHW2OK2PIYQGNRJ5XG23YTQ7RQ, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.142718061 (21h43m43.03642668s) [noise=true , address=185.167.204.205:4017 , piece_id=S3IEI2AKX7TWBUPQZ7CHQEA4S3CKRQOE24J42JNIXRO6DEHB6XFA, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.143181153 (21h43m43.036889772s) [noise=true , address=185.167.204.206:4048 , piece_id=7R655HVH2N6SRLQKHDXUV4SUIJIBUV74XQR2EQPGAHYRPQV4KHSA, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.143548833 (21h43m43.037257442s) [noise=true , address=81.171.14.70:4042 , piece_id=RTNRKUNG5DNPSCMYG6HI3QXMYIHRXBNVGOXFWWQYUOADGAWCSIUA, seg_pos={0 0}, upload=19080]: Uploading piece...
Jan 16 13:39:46.969931622 (21h43m43.863640231s) [upload=19080]: Next returned nil segment
Jan 16 13:39:46.969942612 (21h43m43.863651221s) [upload=19080]: Waiting for error group managing segments...
Jan 16 13:39:47.358574118 (21h43m44.252282727s) [noise=true , address=81.171.14.70:4041 , piece_id=S6WMUOPW77XUJ3XU4OR5CN77VSYXBVKRQ3XTOOIHCIPWMR5UNFZA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.376906154 (21h43m44.270614763s) [noise=true , address=81.171.14.70:4036 , piece_id=QN7B2DUYMWPRNOAMSNS6RHBNALHTD2DOINIHB4LCT3YIBGZZGJVQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.386359813 (21h43m44.280068422s) [noise=true , address=81.171.14.70:4026 , piece_id=Q3ATGEPXQILOU3TB7T26LXLAAYYNMYHGMOS3AR5MZ4TA3B2WQAFA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.391293989 (21h43m44.285002608s) [noise=true , address=81.171.14.70:4040 , piece_id=N4BPXSNU7N6YGS4DB5OKQABXHTMGZJ5H5MF3TLNEMH66IVPF6OIQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.393020717 (21h43m44.286729326s) [noise=true , address=81.171.14.70:4042 , piece_id=RTNRKUNG5DNPSCMYG6HI3QXMYIHRXBNVGOXFWWQYUOADGAWCSIUA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.396217273 (21h43m44.289925892s) [noise=true , address=81.171.14.70:4037 , piece_id=IERG62NVFXDMM27B2DSSAF43HNKB6KL2BHPPLCXSV7SLZEX22Q2Q, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.704387476 (21h43m44.598096085s) [noise=true , address=185.167.204.206:4037 , piece_id=NFEZPWZSFICRZXJ46AZNEQNDKNONUBHK7EDCAKKH5AOK6DFQJZGA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.710467703 (21h43m44.604176312s) [noise=true , address=185.167.204.205:4035 , piece_id=QM4RJK2NJNLLEQB5BVN5AAA4I4QVRGE6JDEFD672S3K5XWFCNQBA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.721346577 (21h43m44.615055186s) [noise=true , address=185.167.204.206:4070 , piece_id=A6GCO6YYOWVWUJZC3CP33EMCNZ7DDJ4QFFBZWYD7PRXTM2AKLHPA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.729385904 (21h43m44.623094523s) [noise=true , address=185.167.204.205:4005 , piece_id=YKRCQYAVVVEKUVJSSWZ6BVF2N2XV2YKACR6TPV3GOQJBGCYPQ4UA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.735337757 (21h43m44.629046376s) [noise=true , address=185.167.204.205:4022 , piece_id=2733QI27ZFIEQKE6QJSYHUJVPSA3LIPZFRV5TTIQYWBNQ2OCVSPQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.740889047 (21h43m44.634597656s) [noise=true , address=185.167.204.206:4038 , piece_id=PXUPUYISL7ULMJYZFPAHY5V65XUVO6M6UOGEI2XLXWWNUP5VWZ2Q, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.755655654 (21h43m44.649364263s) [noise=true , address=185.167.204.205:4033 , piece_id=M4JYVQMSWRO53S6PCMX4KGGTGLBA3BCW4N6XE4DZD4KCQX47NLAQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.755687955 (21h43m44.649396564s) [noise=true , address=185.167.204.205:4013 , piece_id=VRMIYOM6WXTUEZXLJ7NZ2BIMPQ267N5J5GVCIEYGKNMHDGRS66XA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.759144076 (21h43m44.652852695s) [noise=true , address=185.167.204.205:4017 , piece_id=S3IEI2AKX7TWBUPQZ7CHQEA4S3CKRQOE24J42JNIXRO6DEHB6XFA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.761003757 (21h43m44.654712366s) [noise=true , address=185.167.204.205:4031 , piece_id=I5KIDXMMQMW4QBYMTRS7W43R54IWCXCY5BDIRR3HYMYEN47JORPQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.763654645 (21h43m44.657363254s) [noise=true , address=185.167.204.205:4007 , piece_id=7MPVUTH73EH5OPTERTJDMLQV7JHZ4XUHCA72XVWUDCUYCGDMCUWA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.772137476 (21h43m44.665846095s) [noise=true , address=185.167.204.206:4048 , piece_id=7R655HVH2N6SRLQKHDXUV4SUIJIBUV74XQR2EQPGAHYRPQV4KHSA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.844490289 (21h43m44.738198908s) [noise=true , address=81.171.14.70:4033 , piece_id=XVRTU7IMLJEIQ7WXOVWCDNZAQF2DRRHSGKY6X7FBLT5CP2RECF3Q, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.874238622 (21h43m44.767947231s) [noise=true , address=81.171.14.70:4035 , piece_id=RD4LZUJBPGZWV6OXUWOWBNPSLPX5WMSELBOGN2IY6OY34ND2A2HA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:47.876778518 (21h43m44.770487147s) [noise=true , address=81.171.14.70:4039 , piece_id=V6M3UTW2SCOEV3RG4LQEFOYGHSZ24LR23I454SLLNLRWSZJWH4AA, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:48.033734761 (21h43m44.92744337s) [noise=true , address=89.149.201.147:4002 , piece_id=43XQFG5DGSMH4EA7BICXWRAFMSBHW2OK2PIYQGNRJ5XG23YTQ7RQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:48.044893469 (21h43m44.938602078s) [noise=true , address=89.149.201.147:4024 , piece_id=A6AMM64QICJBFRDVCVRKK574L4NCT22ESOVAFGRS3I3OZWHC4RAQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:48.054007682 (21h43m44.947716291s) [noise=true , address=89.149.201.147:4018 , piece_id=ED5N6V45S2Z6H7M5GVIABLFQNXEYYCCTVPUO4EDLKO5FFXSHXHPQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:39:48.139825555 (21h43m45.033534164s) [noise=true , address=89.149.201.147:4009 , piece_id=BWSDC25ATTGK32IIKZBQYTJFYTQPNBDWEZUOPY6SMWK5AEX2O3KQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: <nil>
Jan 16 13:40:45.486720649 (21h44m42.380429268s) [noise=true , address=89.149.201.147:4014 , piece_id=4AMYLKAQKIINVU76QNAGUH7W3RGPII2CJD4NCDS3Q3LN7RADPBIQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: write tcp 188.166.225.170:50946->89.149.201.147:4014: use of closed network connection; write tcp 188.166.225.170:50946->89.149.201.147:4014: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50946->89.149.201.147:4014: use of closed network connection
Jan 16 13:40:45.486902295 (21h44m42.380610924s) [noise=true , address=89.149.201.147:4007 , piece_id=DOPWPQ4XFQAWCHSOF3BSVWERB62J2RUW5GQHPLNIS7R53KTDDDEQ, seg_pos={0 0}, upload=19080]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: write tcp 188.166.225.170:37326->89.149.201.147:4007: use of closed network connection; write tcp 188.166.225.170:37326->89.149.201.147:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37326->89.149.201.147:4007: use of closed network connection
Jan 16 13:40:45.487013636 (21h44m42.380722255s) [noise=true , address=89.149.201.147:4019 , piece_id=QOGUAPCIS2XZPEMAJKXF764MRX6G6MRMQDRU3COCSWCBFOCDQI4A, seg_pos={0 0}, upload=19080]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: write tcp 188.166.225.170:48924->89.149.201.147:4019: use of closed network connection; write tcp 188.166.225.170:48924->89.149.201.147:4019: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48924->89.149.201.147:4019: use of closed network connection
Jan 16 13:40:45.487057010 (21h44m42.380765619s) [seg_pos={0 0}, upload=19080]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 16 13:40:45.651521990 (21h44m42.545230599s) [upload=19080]: Done uploading segments...
Jan 16 13:40:45.651556576 (21h44m42.545265195s) [upload=19080]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.167363081s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXXX] duration:
30.001284542s trace:
https://jaeger.dev.storj.io/trace/15706f5387d8248
FAIL (2026-01-16 13:40:10 UTC)
orbiter warning: context deadline exceeded
Duration: 30.001297846s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
16.865465577s trace:
https://jaeger.dev.storj.io/trace/6b9a0c4bfefdaf17
FAIL (2026-01-16 13:40:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 16.865483952s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000450363s trace:
https://jaeger.dev.storj.io/trace/53c729714cc39587
FAIL (2026-01-16 13:40:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000471293s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [XX.....X..XX..X.............X.X............X.............X..] duration:
17.007935968s trace:
https://jaeger.dev.storj.io/trace/3871a78b77f28770
FAIL (2026-01-16 13:39:53 UTC)
orbiter warning: context deadline exceeded
Duration: 17.008047751s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
51 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX.XXXXXXXX.XXXX..XXX..XXX.X..XXXXXXXXXXXXXXX] duration:
30.000841048s trace:
https://jaeger.dev.storj.io/trace/401066eac4ec3d37
FAIL (2026-01-16 13:39:40 UTC)
orbiter warning: context deadline exceeded
Duration: 30.000861186s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
60 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
5.000833142s trace:
https://jaeger.dev.storj.io/trace/69072a57da5075c
FAIL (2026-01-16 13:39:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000864501s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [.XX.....X..XX..X.............X.X............X.............X.] duration:
19.241798457s trace:
https://jaeger.dev.storj.io/trace/3871a78b77f28770
FAIL (2026-01-16 13:39:20 UTC)
orbiter warning: context deadline exceeded
Duration: 19.241812254s
core
uplink
us-select-1
us1-placement-20
|