Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................X....................] duration:
3.577235156s trace:
https://jaeger.dev.storj.io/trace/4397eafaecf406f2
FAIL (2026-02-11 06:36:35 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.577289753s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.947452683s trace:
https://jaeger.dev.storj.io/trace/5b7d109ad0eb908c
FAIL (2026-02-11 06:36:33 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.947480618s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.564888293s trace:
https://jaeger.dev.storj.io/trace/3952a44650a1383d
FAIL (2026-02-11 06:36:28 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 5.564910657s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.411319347s trace:
https://jaeger.dev.storj.io/trace/3952a44650a1383d
FAIL (2026-02-11 06:36:02 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 5.411345879s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X................................................X.....] duration:
5.730015549s trace:
https://jaeger.dev.storj.io/trace/2cf6b949bd69bb31
FAIL (2026-02-11 06:35:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 11 06:31:56.206768654 (18h41m10.095953055s) [upload=16475]: Starting upload
Feb 11 06:31:56.206899487 (18h41m10.096083897s) [upload=16475]: Done starting upload
Feb 11 06:31:56.206973570 (18h41m10.09615794s) [upload=16475]: Uploading segments...
Feb 11 06:31:56.207106155 (18h41m10.096290525s) [upload=16475]: Got next segment. Inline: false
Feb 11 06:31:56.207132075 (18h41m10.096316445s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 11 06:31:56.207136304 (18h41m10.096320674s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 11 06:31:56.447825122 (18h41m10.337009492s) [seg_pos={0 0}, upload=16475]: Begin upload segment...
Feb 11 06:31:56.447880098 (18h41m10.337064478s) [seg_pos={0 0}, upload=16475]: Done begin upload segment.
Feb 11 06:31:56.447896099 (18h41m10.337080469s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.447909555 (18h41m10.337093935s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448069944 (18h41m10.337254314s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448401975 (18h41m10.337586345s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448408026 (18h41m10.337592396s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448673339 (18h41m10.337857709s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448765417 (18h41m10.337949797s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449095263 (18h41m10.338279633s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449123667 (18h41m10.338308048s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449380313 (18h41m10.338564683s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449468854 (18h41m10.338653224s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449616639 (18h41m10.338801009s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449862985 (18h41m10.339047365s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449891359 (18h41m10.339075729s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450134298 (18h41m10.339318668s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450229983 (18h41m10.339414363s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:58.209876562 (18h41m12.099060922s) [upload=16475]: Next returned nil segment
Feb 11 06:31:58.209888625 (18h41m12.099072995s) [upload=16475]: Waiting for error group managing segments...
Feb 11 06:31:58.496691396 (18h41m12.385875776s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.529060844 (18h41m12.418245214s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.559908364 (18h41m12.449092734s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:00.350391092 (18h41m14.239575472s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.247469983 (18h41m15.136654353s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.829357727 (18h41m15.718542107s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.982011244 (18h41m15.871195624s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:02.484081944 (18h41m16.373266314s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:04.803156554 (18h41m18.692340924s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:05.005301389 (18h41m18.894485789s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:13.710531707 (18h41m27.599716077s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:25.544906493 (18h41m39.434090863s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1khNvxTmr2av1PFmxCv4cEcMv25F9y41bndYPQKuP2LCx7WoMQ, address:145.79.227.8:4332): protocol: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection
Feb 11 06:32:25.544955328 (18h41m39.434139698s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection
Feb 11 06:32:25.545083355 (18h41m39.434267725s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw, address:145.79.227.48:4306): protocol: read tcp 188.166.225.170:53584->145.79.227.48:4306: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545326374 (18h41m39.434510744s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection
Feb 11 06:32:25.545683923 (18h41m39.434868293s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: read tcp 188.166.225.170:46382->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545725284 (18h41m39.434909664s) [seg_pos={0 0}, upload=16475]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 11 06:32:25.918112017 (18h41m39.807296387s) [upload=16475]: Done uploading segments...
Feb 11 06:32:25.918146855 (18h41m39.807331225s) [upload=16475]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 5.730035627s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
1.917893108s trace:
https://jaeger.dev.storj.io/trace/eede8ca143ffc09
FAIL (2026-02-11 06:35:56 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.917916543s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.278347028s trace:
https://jaeger.dev.storj.io/trace/af0689e560f70d8
FAIL (2026-02-11 06:35:39 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 6.278370924s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
676.442168ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/dfe5c7334a14c9e
FAIL (2026-02-11 06:35:27 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 676.470252ms
core
satellite
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................X...................] duration:
3.554193969s trace:
https://jaeger.dev.storj.io/trace/4397eafaecf406f2
FAIL (2026-02-11 06:35:26 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.5542199s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.906206896s trace:
https://jaeger.dev.storj.io/trace/5b7d109ad0eb908c
FAIL (2026-02-11 06:35:21 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.906232625s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X................................................X....] duration:
5.938480972s trace:
https://jaeger.dev.storj.io/trace/2cf6b949bd69bb31
FAIL (2026-02-11 06:35:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 11 06:31:56.206768654 (18h41m10.095953055s) [upload=16475]: Starting upload
Feb 11 06:31:56.206899487 (18h41m10.096083897s) [upload=16475]: Done starting upload
Feb 11 06:31:56.206973570 (18h41m10.09615794s) [upload=16475]: Uploading segments...
Feb 11 06:31:56.207106155 (18h41m10.096290525s) [upload=16475]: Got next segment. Inline: false
Feb 11 06:31:56.207132075 (18h41m10.096316445s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 11 06:31:56.207136304 (18h41m10.096320674s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 11 06:31:56.447825122 (18h41m10.337009492s) [seg_pos={0 0}, upload=16475]: Begin upload segment...
Feb 11 06:31:56.447880098 (18h41m10.337064478s) [seg_pos={0 0}, upload=16475]: Done begin upload segment.
Feb 11 06:31:56.447896099 (18h41m10.337080469s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.447909555 (18h41m10.337093935s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448069944 (18h41m10.337254314s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448401975 (18h41m10.337586345s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448408026 (18h41m10.337592396s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448673339 (18h41m10.337857709s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448765417 (18h41m10.337949797s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449095263 (18h41m10.338279633s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449123667 (18h41m10.338308048s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449380313 (18h41m10.338564683s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449468854 (18h41m10.338653224s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449616639 (18h41m10.338801009s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449862985 (18h41m10.339047365s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449891359 (18h41m10.339075729s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450134298 (18h41m10.339318668s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450229983 (18h41m10.339414363s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:58.209876562 (18h41m12.099060922s) [upload=16475]: Next returned nil segment
Feb 11 06:31:58.209888625 (18h41m12.099072995s) [upload=16475]: Waiting for error group managing segments...
Feb 11 06:31:58.496691396 (18h41m12.385875776s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.529060844 (18h41m12.418245214s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.559908364 (18h41m12.449092734s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:00.350391092 (18h41m14.239575472s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.247469983 (18h41m15.136654353s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.829357727 (18h41m15.718542107s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.982011244 (18h41m15.871195624s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:02.484081944 (18h41m16.373266314s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:04.803156554 (18h41m18.692340924s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:05.005301389 (18h41m18.894485789s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:13.710531707 (18h41m27.599716077s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:25.544906493 (18h41m39.434090863s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1khNvxTmr2av1PFmxCv4cEcMv25F9y41bndYPQKuP2LCx7WoMQ, address:145.79.227.8:4332): protocol: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection
Feb 11 06:32:25.544955328 (18h41m39.434139698s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection
Feb 11 06:32:25.545083355 (18h41m39.434267725s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw, address:145.79.227.48:4306): protocol: read tcp 188.166.225.170:53584->145.79.227.48:4306: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545326374 (18h41m39.434510744s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection
Feb 11 06:32:25.545683923 (18h41m39.434868293s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: read tcp 188.166.225.170:46382->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545725284 (18h41m39.434909664s) [seg_pos={0 0}, upload=16475]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 11 06:32:25.918112017 (18h41m39.807296387s) [upload=16475]: Done uploading segments...
Feb 11 06:32:25.918146855 (18h41m39.807331225s) [upload=16475]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 5.938537471s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.911090591s trace:
https://jaeger.dev.storj.io/trace/5b7d109ad0eb908c
FAIL (2026-02-11 06:35:05 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.911125198s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
1.968494491s trace:
https://jaeger.dev.storj.io/trace/eede8ca143ffc09
FAIL (2026-02-11 06:35:02 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.968522165s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.471601259s trace:
https://jaeger.dev.storj.io/trace/3952a44650a1383d
FAIL (2026-02-11 06:34:56 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 5.471619665s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.651129041s trace:
https://jaeger.dev.storj.io/trace/af0689e560f70d8
FAIL (2026-02-11 06:34:42 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 5.651152336s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
1.962249107s trace:
https://jaeger.dev.storj.io/trace/eede8ca143ffc09
FAIL (2026-02-11 06:34:26 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.962286439s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
671.676544ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/dfe5c7334a14c9e
FAIL (2026-02-11 06:34:23 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 671.704798ms
core
satellite
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................X..................] duration:
3.662160179s trace:
https://jaeger.dev.storj.io/trace/4397eafaecf406f2
FAIL (2026-02-11 06:34:20 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.662183715s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.402838565s trace:
https://jaeger.dev.storj.io/trace/3952a44650a1383d
FAIL (2026-02-11 06:34:19 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 5.402862762s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X................................................X...] duration:
5.729195148s trace:
https://jaeger.dev.storj.io/trace/2cf6b949bd69bb31
FAIL (2026-02-11 06:34:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 11 06:31:56.206768654 (18h41m10.095953055s) [upload=16475]: Starting upload
Feb 11 06:31:56.206899487 (18h41m10.096083897s) [upload=16475]: Done starting upload
Feb 11 06:31:56.206973570 (18h41m10.09615794s) [upload=16475]: Uploading segments...
Feb 11 06:31:56.207106155 (18h41m10.096290525s) [upload=16475]: Got next segment. Inline: false
Feb 11 06:31:56.207132075 (18h41m10.096316445s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 11 06:31:56.207136304 (18h41m10.096320674s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 11 06:31:56.447825122 (18h41m10.337009492s) [seg_pos={0 0}, upload=16475]: Begin upload segment...
Feb 11 06:31:56.447880098 (18h41m10.337064478s) [seg_pos={0 0}, upload=16475]: Done begin upload segment.
Feb 11 06:31:56.447896099 (18h41m10.337080469s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.447909555 (18h41m10.337093935s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448069944 (18h41m10.337254314s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448401975 (18h41m10.337586345s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448408026 (18h41m10.337592396s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448673339 (18h41m10.337857709s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448765417 (18h41m10.337949797s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449095263 (18h41m10.338279633s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449123667 (18h41m10.338308048s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449380313 (18h41m10.338564683s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449468854 (18h41m10.338653224s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449616639 (18h41m10.338801009s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449862985 (18h41m10.339047365s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449891359 (18h41m10.339075729s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450134298 (18h41m10.339318668s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450229983 (18h41m10.339414363s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:58.209876562 (18h41m12.099060922s) [upload=16475]: Next returned nil segment
Feb 11 06:31:58.209888625 (18h41m12.099072995s) [upload=16475]: Waiting for error group managing segments...
Feb 11 06:31:58.496691396 (18h41m12.385875776s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.529060844 (18h41m12.418245214s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.559908364 (18h41m12.449092734s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:00.350391092 (18h41m14.239575472s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.247469983 (18h41m15.136654353s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.829357727 (18h41m15.718542107s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.982011244 (18h41m15.871195624s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:02.484081944 (18h41m16.373266314s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:04.803156554 (18h41m18.692340924s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:05.005301389 (18h41m18.894485789s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:13.710531707 (18h41m27.599716077s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:25.544906493 (18h41m39.434090863s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1khNvxTmr2av1PFmxCv4cEcMv25F9y41bndYPQKuP2LCx7WoMQ, address:145.79.227.8:4332): protocol: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection
Feb 11 06:32:25.544955328 (18h41m39.434139698s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection
Feb 11 06:32:25.545083355 (18h41m39.434267725s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw, address:145.79.227.48:4306): protocol: read tcp 188.166.225.170:53584->145.79.227.48:4306: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545326374 (18h41m39.434510744s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection
Feb 11 06:32:25.545683923 (18h41m39.434868293s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: read tcp 188.166.225.170:46382->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545725284 (18h41m39.434909664s) [seg_pos={0 0}, upload=16475]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 11 06:32:25.918112017 (18h41m39.807296387s) [upload=16475]: Done uploading segments...
Feb 11 06:32:25.918146855 (18h41m39.807331225s) [upload=16475]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 5.729227871s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.942991123s trace:
https://jaeger.dev.storj.io/trace/5b7d109ad0eb908c
FAIL (2026-02-11 06:34:05 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.943032763s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.747653277s trace:
https://jaeger.dev.storj.io/trace/af0689e560f70d8
FAIL (2026-02-11 06:33:45 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 5.747679278s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
667.39007ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/dfe5c7334a14c9e
FAIL (2026-02-11 06:33:43 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 667.411972ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X................................................X..] duration:
5.737904101s trace:
https://jaeger.dev.storj.io/trace/2cf6b949bd69bb31
FAIL (2026-02-11 06:33:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 11 06:31:56.206768654 (18h41m10.095953055s) [upload=16475]: Starting upload
Feb 11 06:31:56.206899487 (18h41m10.096083897s) [upload=16475]: Done starting upload
Feb 11 06:31:56.206973570 (18h41m10.09615794s) [upload=16475]: Uploading segments...
Feb 11 06:31:56.207106155 (18h41m10.096290525s) [upload=16475]: Got next segment. Inline: false
Feb 11 06:31:56.207132075 (18h41m10.096316445s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 11 06:31:56.207136304 (18h41m10.096320674s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 11 06:31:56.447825122 (18h41m10.337009492s) [seg_pos={0 0}, upload=16475]: Begin upload segment...
Feb 11 06:31:56.447880098 (18h41m10.337064478s) [seg_pos={0 0}, upload=16475]: Done begin upload segment.
Feb 11 06:31:56.447896099 (18h41m10.337080469s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.447909555 (18h41m10.337093935s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448069944 (18h41m10.337254314s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448401975 (18h41m10.337586345s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448408026 (18h41m10.337592396s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448673339 (18h41m10.337857709s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448765417 (18h41m10.337949797s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449095263 (18h41m10.338279633s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449123667 (18h41m10.338308048s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449380313 (18h41m10.338564683s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449468854 (18h41m10.338653224s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449616639 (18h41m10.338801009s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449862985 (18h41m10.339047365s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449891359 (18h41m10.339075729s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450134298 (18h41m10.339318668s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450229983 (18h41m10.339414363s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:58.209876562 (18h41m12.099060922s) [upload=16475]: Next returned nil segment
Feb 11 06:31:58.209888625 (18h41m12.099072995s) [upload=16475]: Waiting for error group managing segments...
Feb 11 06:31:58.496691396 (18h41m12.385875776s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.529060844 (18h41m12.418245214s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.559908364 (18h41m12.449092734s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:00.350391092 (18h41m14.239575472s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.247469983 (18h41m15.136654353s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.829357727 (18h41m15.718542107s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.982011244 (18h41m15.871195624s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:02.484081944 (18h41m16.373266314s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:04.803156554 (18h41m18.692340924s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:05.005301389 (18h41m18.894485789s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:13.710531707 (18h41m27.599716077s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:25.544906493 (18h41m39.434090863s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1khNvxTmr2av1PFmxCv4cEcMv25F9y41bndYPQKuP2LCx7WoMQ, address:145.79.227.8:4332): protocol: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection
Feb 11 06:32:25.544955328 (18h41m39.434139698s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection
Feb 11 06:32:25.545083355 (18h41m39.434267725s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw, address:145.79.227.48:4306): protocol: read tcp 188.166.225.170:53584->145.79.227.48:4306: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545326374 (18h41m39.434510744s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection
Feb 11 06:32:25.545683923 (18h41m39.434868293s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: read tcp 188.166.225.170:46382->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545725284 (18h41m39.434909664s) [seg_pos={0 0}, upload=16475]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 11 06:32:25.918112017 (18h41m39.807296387s) [upload=16475]: Done uploading segments...
Feb 11 06:32:25.918146855 (18h41m39.807331225s) [upload=16475]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 5.737928839s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
1.933928073s trace:
https://jaeger.dev.storj.io/trace/eede8ca143ffc09
FAIL (2026-02-11 06:33:30 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.933972149s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.251390291s trace:
https://jaeger.dev.storj.io/trace/3952a44650a1383d
FAIL (2026-02-11 06:33:25 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 5.251419055s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.627076401s trace:
https://jaeger.dev.storj.io/trace/af0689e560f70d8
FAIL (2026-02-11 06:33:25 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 5.627090317s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................X.................] duration:
3.766553748s trace:
https://jaeger.dev.storj.io/trace/4397eafaecf406f2
FAIL (2026-02-11 06:33:22 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.766574499s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X................................................X.] duration:
6.242092448s trace:
https://jaeger.dev.storj.io/trace/2cf6b949bd69bb31
FAIL (2026-02-11 06:33:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 11 06:31:56.206768654 (18h41m10.095953055s) [upload=16475]: Starting upload
Feb 11 06:31:56.206899487 (18h41m10.096083897s) [upload=16475]: Done starting upload
Feb 11 06:31:56.206973570 (18h41m10.09615794s) [upload=16475]: Uploading segments...
Feb 11 06:31:56.207106155 (18h41m10.096290525s) [upload=16475]: Got next segment. Inline: false
Feb 11 06:31:56.207132075 (18h41m10.096316445s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 11 06:31:56.207136304 (18h41m10.096320674s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 11 06:31:56.447825122 (18h41m10.337009492s) [seg_pos={0 0}, upload=16475]: Begin upload segment...
Feb 11 06:31:56.447880098 (18h41m10.337064478s) [seg_pos={0 0}, upload=16475]: Done begin upload segment.
Feb 11 06:31:56.447896099 (18h41m10.337080469s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.447909555 (18h41m10.337093935s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448069944 (18h41m10.337254314s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448401975 (18h41m10.337586345s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448408026 (18h41m10.337592396s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448673339 (18h41m10.337857709s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448765417 (18h41m10.337949797s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449095263 (18h41m10.338279633s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449123667 (18h41m10.338308048s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449380313 (18h41m10.338564683s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449468854 (18h41m10.338653224s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449616639 (18h41m10.338801009s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449862985 (18h41m10.339047365s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449891359 (18h41m10.339075729s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450134298 (18h41m10.339318668s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450229983 (18h41m10.339414363s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:58.209876562 (18h41m12.099060922s) [upload=16475]: Next returned nil segment
Feb 11 06:31:58.209888625 (18h41m12.099072995s) [upload=16475]: Waiting for error group managing segments...
Feb 11 06:31:58.496691396 (18h41m12.385875776s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.529060844 (18h41m12.418245214s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.559908364 (18h41m12.449092734s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:00.350391092 (18h41m14.239575472s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.247469983 (18h41m15.136654353s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.829357727 (18h41m15.718542107s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.982011244 (18h41m15.871195624s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:02.484081944 (18h41m16.373266314s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:04.803156554 (18h41m18.692340924s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:05.005301389 (18h41m18.894485789s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:13.710531707 (18h41m27.599716077s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:25.544906493 (18h41m39.434090863s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1khNvxTmr2av1PFmxCv4cEcMv25F9y41bndYPQKuP2LCx7WoMQ, address:145.79.227.8:4332): protocol: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection
Feb 11 06:32:25.544955328 (18h41m39.434139698s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection
Feb 11 06:32:25.545083355 (18h41m39.434267725s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw, address:145.79.227.48:4306): protocol: read tcp 188.166.225.170:53584->145.79.227.48:4306: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545326374 (18h41m39.434510744s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection
Feb 11 06:32:25.545683923 (18h41m39.434868293s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: read tcp 188.166.225.170:46382->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545725284 (18h41m39.434909664s) [seg_pos={0 0}, upload=16475]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 11 06:32:25.918112017 (18h41m39.807296387s) [upload=16475]: Done uploading segments...
Feb 11 06:32:25.918146855 (18h41m39.807331225s) [upload=16475]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 6.242122827s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
1.942476027s trace:
https://jaeger.dev.storj.io/trace/eede8ca143ffc09
FAIL (2026-02-11 06:33:12 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.942505073s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
6.1339626s trace:
https://jaeger.dev.storj.io/trace/af0689e560f70d8
FAIL (2026-02-11 06:33:08 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 6.133995755s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.954000759s trace:
https://jaeger.dev.storj.io/trace/5b7d109ad0eb908c
FAIL (2026-02-11 06:32:56 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.954028474s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................X................] duration:
3.731654661s trace:
https://jaeger.dev.storj.io/trace/4397eafaecf406f2
FAIL (2026-02-11 06:32:37 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.731671624s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.081059171s target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/dfe5c7334a14c9e
FAIL (2026-02-11 06:32:33 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 1.081083168s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
10.116862734s trace:
https://jaeger.dev.storj.io/trace/af0689e560f70d8
FAIL (2026-02-11 06:32:27 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 10.11688177s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X................................................X] duration:
30.374321028s trace:
https://jaeger.dev.storj.io/trace/2cf6b949bd69bb31
FAIL (2026-02-11 06:32:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 11 06:31:56.206768654 (18h41m10.095953055s) [upload=16475]: Starting upload
Feb 11 06:31:56.206899487 (18h41m10.096083897s) [upload=16475]: Done starting upload
Feb 11 06:31:56.206973570 (18h41m10.09615794s) [upload=16475]: Uploading segments...
Feb 11 06:31:56.207106155 (18h41m10.096290525s) [upload=16475]: Got next segment. Inline: false
Feb 11 06:31:56.207132075 (18h41m10.096316445s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 11 06:31:56.207136304 (18h41m10.096320674s) [upload=16475]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 11 06:31:56.447825122 (18h41m10.337009492s) [seg_pos={0 0}, upload=16475]: Begin upload segment...
Feb 11 06:31:56.447880098 (18h41m10.337064478s) [seg_pos={0 0}, upload=16475]: Done begin upload segment.
Feb 11 06:31:56.447896099 (18h41m10.337080469s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.447909555 (18h41m10.337093935s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448069944 (18h41m10.337254314s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448401975 (18h41m10.337586345s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448408026 (18h41m10.337592396s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448673339 (18h41m10.337857709s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.448765417 (18h41m10.337949797s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449095263 (18h41m10.338279633s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449123667 (18h41m10.338308048s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449380313 (18h41m10.338564683s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449468854 (18h41m10.338653224s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449616639 (18h41m10.338801009s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449862985 (18h41m10.339047365s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.449891359 (18h41m10.339075729s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450134298 (18h41m10.339318668s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:56.450229983 (18h41m10.339414363s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Uploading piece...
Feb 11 06:31:58.209876562 (18h41m12.099060922s) [upload=16475]: Next returned nil segment
Feb 11 06:31:58.209888625 (18h41m12.099072995s) [upload=16475]: Waiting for error group managing segments...
Feb 11 06:31:58.496691396 (18h41m12.385875776s) [noise=true , address=79.127.219.41:4927 , piece_id=BH2SG3WUHFH5R7S2RK7JBU3IQLZIHW5PEAA66AONGWSEAUAFVNTQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.529060844 (18h41m12.418245214s) [noise=true , address=145.79.227.17:4975 , piece_id=HWAU7RD6RXI7SLG76XQ37HEVABV3R6LMKQNKMD6KGHNIGTUM6DNQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:31:58.559908364 (18h41m12.449092734s) [noise=true , address=145.79.227.52:4446 , piece_id=3T7L6AJNKVG7NO2MPDMXEA2OW2IBV4W6EUIDYZNLPUULZIXMGHPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:00.350391092 (18h41m14.239575472s) [noise=true , address=145.79.227.38:4982 , piece_id=34KNKGZDPQ7NIA6WGMWW2TXER37SUXHQIMQPXWV2Z2C4IRQHXLPQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.247469983 (18h41m15.136654353s) [noise=true , address=145.79.227.32:4839 , piece_id=QG5RQQVXTUDW6ARGKWH7XK3UH3F6RSQHW5MSMK2C2DU3UZSA67XA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.829357727 (18h41m15.718542107s) [noise=true , address=145.79.227.46:4606 , piece_id=KD47N744GL3ZA2TQSD2ZGYHAIWSEYNHYKXUH7JQDUW2KMAKVASTA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:01.982011244 (18h41m15.871195624s) [noise=true , address=145.79.227.28:4730 , piece_id=26UV5S77STIUNHVPH2AT6YBTLGMRS47EIHSJPR34LJI7ICFGOSGA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:02.484081944 (18h41m16.373266314s) [noise=true , address=145.79.227.51:4415 , piece_id=VS3EKIYCCLMT7CZKMDOK3HR37VPQJQLM42QDJZLHJS4ELXAUCRLA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:04.803156554 (18h41m18.692340924s) [noise=true , address=145.79.227.43:4162 , piece_id=QHVYIQYFGA6GHYML6QLWFOF6HUMYIKL6V5QDZD5ABOFQ4GYD2HRQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:05.005301389 (18h41m18.894485789s) [noise=true , address=145.79.227.11:4735 , piece_id=FUZQQBORU7XYHDBGA5ZUNCWXKFTFDHASUD7RLDROFJV4DKODFKVA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:13.710531707 (18h41m27.599716077s) [noise=true , address=145.79.227.12:4771 , piece_id=7N23OUQMNKWYXZZBDOGBLO3ERSDAHHP4R7L2JMX5LBNAIKVZ356A, seg_pos={0 0}, upload=16475]: Done uploading piece. err: <nil>
Feb 11 06:32:25.544906493 (18h41m39.434090863s) [noise=true , address=145.79.227.8:4332 , piece_id=7EK76FFWMYC6IPG4NUQNVIURJQJAIIOXE6YGLOIWUUNVZDMSACXQ, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1khNvxTmr2av1PFmxCv4cEcMv25F9y41bndYPQKuP2LCx7WoMQ, address:145.79.227.8:4332): protocol: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55244->145.79.227.8:4332: use of closed network connection
Feb 11 06:32:25.544955328 (18h41m39.434139698s) [noise=true , address=145.79.227.49:4342 , piece_id=FLLMYMXSX4SJAGVR7GYK2GLDNEVMZGKW4K4WC4L3SFQ7EFW432UA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB, address:145.79.227.49:4342): protocol: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54578->145.79.227.49:4342: use of closed network connection
Feb 11 06:32:25.545083355 (18h41m39.434267725s) [noise=true , address=145.79.227.48:4306 , piece_id=EPGPOETEX2FO3AEY4H7NBL7FV5MFFK2J6RXFXEOAJ3PXCNAYIWSA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw, address:145.79.227.48:4306): protocol: read tcp 188.166.225.170:53584->145.79.227.48:4306: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545326374 (18h41m39.434510744s) [noise=true , address=145.79.227.10:4404 , piece_id=HK5ZXPUMH7FITDGUWB7OSLSNJF3S66PGN4IVWLSEMDGS2VQMJAOA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38510->145.79.227.10:4404: use of closed network connection
Feb 11 06:32:25.545683923 (18h41m39.434868293s) [noise=true , address=145.79.227.19:4077 , piece_id=CTU4TDN2R3O4HUUS2A4ZGSVM76VIQNBD3VGUAMQUCNTLA7DS7NEA, seg_pos={0 0}, upload=16475]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: read tcp 188.166.225.170:46382->145.79.227.19:4077: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 11 06:32:25.545725284 (18h41m39.434909664s) [seg_pos={0 0}, upload=16475]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 11 06:32:25.918112017 (18h41m39.807296387s) [upload=16475]: Done uploading segments...
Feb 11 06:32:25.918146855 (18h41m39.807331225s) [upload=16475]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 30.374345043s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
7.372132226s trace:
https://jaeger.dev.storj.io/trace/3952a44650a1383d
FAIL (2026-02-11 06:32:21 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 7.372161261s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
4.154816868s trace:
https://jaeger.dev.storj.io/trace/5b7d109ad0eb908c
FAIL (2026-02-11 06:32:20 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.154844081s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................] duration:
3.021491733s trace:
https://jaeger.dev.storj.io/trace/eede8ca143ffc09
FAIL (2026-02-11 06:32:17 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 3.021518926s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................................X...............] duration:
3.737882291s trace:
https://jaeger.dev.storj.io/trace/4397eafaecf406f2
FAIL (2026-02-11 06:32:14 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.737910976s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.416277961s trace:
https://jaeger.dev.storj.io/trace/3952a44650a1383d
FAIL (2026-02-11 06:31:55 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 5.416318498s
core
uplink
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
673.125048ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/dfe5c7334a14c9e
FAIL (2026-02-11 06:31:53 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 673.181908ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................] duration:
1.964693066s trace:
https://jaeger.dev.storj.io/trace/eede8ca143ffc09
FAIL (2026-02-11 06:31:36 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.964730668s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
6.457345121s trace:
https://jaeger.dev.storj.io/trace/af0689e560f70d8
FAIL (2026-02-11 06:31:31 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 6.457362676s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................................X..............] duration:
3.482283948s trace:
https://jaeger.dev.storj.io/trace/4397eafaecf406f2
FAIL (2026-02-11 06:31:28 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.482308214s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.941316582s trace:
https://jaeger.dev.storj.io/trace/5b7d109ad0eb908c
FAIL (2026-02-11 06:31:21 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.941344787s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.649425602s trace:
https://jaeger.dev.storj.io/trace/af0689e560f70d8
FAIL (2026-02-11 06:31:14 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 5.649449888s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
674.040256ms target:
https://us1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/dfe5c7334a14c9e
FAIL (2026-02-11 06:31:13 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 674.065323ms
core
satellite
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................................X.............] duration:
3.544484795s trace:
https://jaeger.dev.storj.io/trace/4397eafaecf406f2
FAIL (2026-02-11 06:31:13 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.544521677s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.816797042s trace:
https://jaeger.dev.storj.io/trace/21802d088d0620b6
FAIL (2026-02-11 06:31:11 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 5.816836416s
core
uplink
us-select-1
|