Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 6.993715945s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:19:33 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 6.993741674s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 31 out of 60 is failed (threshold=6) [.......XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXXXX.X..XXX.] duration: 5.001186934s trace: https://jaeger.dev.storj.io/trace/14e3ea21b72ddd06 FAIL (2025-12-05 13:19:26 UTC) orbiter warning: context deadline exceeded Duration: 5.00121593s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.377692393s trace: https://jaeger.dev.storj.io/trace/16d0fd0d28b4b6f7 FAIL (2025-12-05 13:19:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.667348134 (44h2m9.138558863s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.668113411 (44h2m9.13932414s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.669515572 (44h2m9.140726301s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670009011 (44h2m9.14121974s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670629353 (44h2m9.141840092s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670996271 (44h2m9.142207s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.671737944 (44h2m9.142948673s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674169844 (44h2m9.145380573s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674772422 (44h2m9.145983151s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675359480 (44h2m9.146570219s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675987596 (44h2m9.147198335s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:33.888855747 (44h2m10.360066487s) [upload=38726]: Next returned nil segment Dec 5 12:57:33.888874513 (44h2m10.360085252s) [upload=38726]: Waiting for error group managing segments... Dec 5 12:57:34.458992275 (44h2m10.930203034s) [noise=true , address=81.171.14.70:4036 , piece_id=G67IW7YF7VX5GRSOUEJECEN66A5HMVZAGCNOEMJ6J76Q3WQCJDBQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.463924437 (44h2m10.935135166s) [noise=true , address=81.171.14.70:4042 , piece_id=V2B6EAOBLNVENCOKBKQHCU5ZAE2L33LSAUSMFCWPXBRSFGS5W7PQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.466804100 (44h2m10.938014849s) [noise=true , address=81.171.14.70:4028 , piece_id=ZQXS4NQTFFY2NJLE6E2CMHFOEVXKXTE5B7WC6EHQNOLZQLBF43KA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.482112661 (44h2m10.9533234s) [noise=true , address=81.171.14.70:4047 , piece_id=4G7U2PYPMWT7QHMFMKWDNIXKDQWPRQBR32R74MD6IOXTFOCGAMJQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.503767315 (44h2m10.974978044s) [noise=true , address=81.171.14.70:4026 , piece_id=6UGKVAGWTYIJ6PKDQOVGBN6TJMKKOT3XAJDJXL6VQ64RLX434Q2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.534018609 (44h2m11.005229339s) [noise=true , address=81.171.14.70:4039 , piece_id=GB3FEVE6G4SHK4VVFKEIH5FV43PGPGCV3BXUSZQQ6CGVTY6EY2MA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.926473649 (44h2m11.397684378s) [noise=true , address=81.171.14.70:4037 , piece_id=6ZNMEGPIZOYN4KQ4N3HKRA3ZTDOE3RQA4MK2BWS52LTN6G2UVTQA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.996303367 (44h2m11.467514097s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.099023697 (44h2m11.570234426s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.112701080 (44h2m11.583911819s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.148224273 (44h2m11.619435002s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.601076549 (44h2m43.072287288s) [noise=true , address=185.167.204.206:4072 , piece_id=GTEJKPFUP4OMHHPMGGNUYAOTRRPSKA7MNPRN5UANZCUCRUJCZQ6A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.858730070 (44h2m43.329940809s) [noise=true , address=185.167.204.205:4013 , piece_id=AWU4445M6HGFROHD7ZON7LF4XHHDBWNGYQ5OBTWRT6ZG7NKIQYPQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.984091582 (44h2m43.455302321s) [noise=true , address=185.167.204.205:4026 , piece_id=4QUQNQEML7X3MWDT3BW2V6HVKMEB34HY5ZOCGJTD4LDH7TOABC4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.997908141 (44h2m43.46911888s) [noise=true , address=185.167.204.205:4027 , piece_id=XE55BFKL5EEYCUI6F3CG2OMHWXTVPADE6N2BIEFODT77MVXUPTKA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:07.704382372 (44h2m44.175593111s) [noise=true , address=185.167.204.206:4052 , piece_id=JV4GC5Y3HXU44FVMMZZDHMN5LD6AK4SO3236KBKKZEZJQ3VOMHLQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:08.306751277 (44h2m44.777962016s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:09.728807001 (44h2m46.20001773s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:10.200462412 (44h2m46.671673151s) [noise=true , address=185.167.204.206:4043 , piece_id=ENHMBBAPVWOYLWG6S2AB75MWWY65ZMWVFGT6LQR6OOH6AMBAANGA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:11.218612754 (44h2m47.689823493s) [noise=true , address=185.167.204.205:4030 , piece_id=JBKFARJUDMQFJIUND5IQTHLCNHQVYHR4P5XOQK24RCDCERC5X72A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:22.049936661 (44h2m58.52114739s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:23.835508896 (44h3m0.306719625s) [noise=true , address=185.167.204.206:4056 , piece_id=GEVQRJW4TE7XTCGJX5HVUSBIKML5ESGM5NWVVDU7ELANJRRT4W5Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:26.013124099 (44h3m2.484334839s) [noise=true , address=185.167.204.206:4041 , piece_id=TOGP35PMCLIUVYB4J6N64ARHRMHKVKQE2IONNQEW32KCPNQYPL2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:27.982649379 (44h3m4.453860109s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:31.996355435 (44h3m8.467566194s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; close tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996542821 (44h3m8.46775356s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996709960 (44h3m8.467920699s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Dec 5 12:58:31.996823235 (44h3m8.468033974s) [noise=true , address=185.167.204.205:4002 , piece_id=4CRJ6ZV5WOJVT7WCEGZHU5HQ56VXZXJ4RB4IBLTRC6CPUQTFOLRA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996866238 (44h3m8.468076977s) [seg_pos={0 0}, upload=38726]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Dec 5 12:58:32.172198764 (44h3m8.643409493s) [upload=38726]: Done uploading segments... Dec 5 12:58:32.172234372 (44h3m8.643445101s) [upload=38726]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.377721559s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.157306325s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:19:06 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.157565659s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 16.749432278s trace: https://jaeger.dev.storj.io/trace/70ddcc9c759b9c09 FAIL (2025-12-05 13:18:58 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 16.749460742s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.210327338s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:18:40 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.210359771s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 31 out of 60 is failed (threshold=6) [........XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXXXX.X..XXX] duration: 5.001397787s trace: https://jaeger.dev.storj.io/trace/14e3ea21b72ddd06 FAIL (2025-12-05 13:18:31 UTC) orbiter warning: context deadline exceeded Duration: 5.001500963s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 7.243137744s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:18:20 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 7.243166049s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 13.593704516s trace: https://jaeger.dev.storj.io/trace/70ddcc9c759b9c09 FAIL (2025-12-05 13:18:20 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 13.593732871s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.236083262s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:18:14 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.236117386s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 16.069915496s trace: https://jaeger.dev.storj.io/trace/70ddcc9c759b9c09 FAIL (2025-12-05 13:18:03 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 16.070291843s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.30971393s trace: https://jaeger.dev.storj.io/trace/16d0fd0d28b4b6f7 FAIL (2025-12-05 13:17:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.667348134 (44h2m9.138558863s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.668113411 (44h2m9.13932414s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.669515572 (44h2m9.140726301s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670009011 (44h2m9.14121974s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670629353 (44h2m9.141840092s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670996271 (44h2m9.142207s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.671737944 (44h2m9.142948673s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674169844 (44h2m9.145380573s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674772422 (44h2m9.145983151s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675359480 (44h2m9.146570219s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675987596 (44h2m9.147198335s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:33.888855747 (44h2m10.360066487s) [upload=38726]: Next returned nil segment Dec 5 12:57:33.888874513 (44h2m10.360085252s) [upload=38726]: Waiting for error group managing segments... Dec 5 12:57:34.458992275 (44h2m10.930203034s) [noise=true , address=81.171.14.70:4036 , piece_id=G67IW7YF7VX5GRSOUEJECEN66A5HMVZAGCNOEMJ6J76Q3WQCJDBQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.463924437 (44h2m10.935135166s) [noise=true , address=81.171.14.70:4042 , piece_id=V2B6EAOBLNVENCOKBKQHCU5ZAE2L33LSAUSMFCWPXBRSFGS5W7PQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.466804100 (44h2m10.938014849s) [noise=true , address=81.171.14.70:4028 , piece_id=ZQXS4NQTFFY2NJLE6E2CMHFOEVXKXTE5B7WC6EHQNOLZQLBF43KA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.482112661 (44h2m10.9533234s) [noise=true , address=81.171.14.70:4047 , piece_id=4G7U2PYPMWT7QHMFMKWDNIXKDQWPRQBR32R74MD6IOXTFOCGAMJQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.503767315 (44h2m10.974978044s) [noise=true , address=81.171.14.70:4026 , piece_id=6UGKVAGWTYIJ6PKDQOVGBN6TJMKKOT3XAJDJXL6VQ64RLX434Q2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.534018609 (44h2m11.005229339s) [noise=true , address=81.171.14.70:4039 , piece_id=GB3FEVE6G4SHK4VVFKEIH5FV43PGPGCV3BXUSZQQ6CGVTY6EY2MA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.926473649 (44h2m11.397684378s) [noise=true , address=81.171.14.70:4037 , piece_id=6ZNMEGPIZOYN4KQ4N3HKRA3ZTDOE3RQA4MK2BWS52LTN6G2UVTQA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.996303367 (44h2m11.467514097s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.099023697 (44h2m11.570234426s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.112701080 (44h2m11.583911819s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.148224273 (44h2m11.619435002s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.601076549 (44h2m43.072287288s) [noise=true , address=185.167.204.206:4072 , piece_id=GTEJKPFUP4OMHHPMGGNUYAOTRRPSKA7MNPRN5UANZCUCRUJCZQ6A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.858730070 (44h2m43.329940809s) [noise=true , address=185.167.204.205:4013 , piece_id=AWU4445M6HGFROHD7ZON7LF4XHHDBWNGYQ5OBTWRT6ZG7NKIQYPQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.984091582 (44h2m43.455302321s) [noise=true , address=185.167.204.205:4026 , piece_id=4QUQNQEML7X3MWDT3BW2V6HVKMEB34HY5ZOCGJTD4LDH7TOABC4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.997908141 (44h2m43.46911888s) [noise=true , address=185.167.204.205:4027 , piece_id=XE55BFKL5EEYCUI6F3CG2OMHWXTVPADE6N2BIEFODT77MVXUPTKA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:07.704382372 (44h2m44.175593111s) [noise=true , address=185.167.204.206:4052 , piece_id=JV4GC5Y3HXU44FVMMZZDHMN5LD6AK4SO3236KBKKZEZJQ3VOMHLQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:08.306751277 (44h2m44.777962016s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:09.728807001 (44h2m46.20001773s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:10.200462412 (44h2m46.671673151s) [noise=true , address=185.167.204.206:4043 , piece_id=ENHMBBAPVWOYLWG6S2AB75MWWY65ZMWVFGT6LQR6OOH6AMBAANGA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:11.218612754 (44h2m47.689823493s) [noise=true , address=185.167.204.205:4030 , piece_id=JBKFARJUDMQFJIUND5IQTHLCNHQVYHR4P5XOQK24RCDCERC5X72A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:22.049936661 (44h2m58.52114739s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:23.835508896 (44h3m0.306719625s) [noise=true , address=185.167.204.206:4056 , piece_id=GEVQRJW4TE7XTCGJX5HVUSBIKML5ESGM5NWVVDU7ELANJRRT4W5Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:26.013124099 (44h3m2.484334839s) [noise=true , address=185.167.204.206:4041 , piece_id=TOGP35PMCLIUVYB4J6N64ARHRMHKVKQE2IONNQEW32KCPNQYPL2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:27.982649379 (44h3m4.453860109s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:31.996355435 (44h3m8.467566194s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; close tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996542821 (44h3m8.46775356s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996709960 (44h3m8.467920699s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Dec 5 12:58:31.996823235 (44h3m8.468033974s) [noise=true , address=185.167.204.205:4002 , piece_id=4CRJ6ZV5WOJVT7WCEGZHU5HQ56VXZXJ4RB4IBLTRC6CPUQTFOLRA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996866238 (44h3m8.468076977s) [seg_pos={0 0}, upload=38726]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Dec 5 12:58:32.172198764 (44h3m8.643409493s) [upload=38726]: Done uploading segments... Dec 5 12:58:32.172234372 (44h3m8.643445101s) [upload=38726]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.309884735s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.31234683s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:17:38 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.312376967s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 30 out of 60 is failed (threshold=6) [.........XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXXXX.X..XX] duration: 5.001846732s trace: https://jaeger.dev.storj.io/trace/32504c1536c49164 FAIL (2025-12-05 13:17:32 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001872561s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.600338374s trace: https://jaeger.dev.storj.io/trace/16d0fd0d28b4b6f7 FAIL (2025-12-05 13:17:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.667348134 (44h2m9.138558863s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.668113411 (44h2m9.13932414s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.669515572 (44h2m9.140726301s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670009011 (44h2m9.14121974s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670629353 (44h2m9.141840092s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670996271 (44h2m9.142207s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.671737944 (44h2m9.142948673s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674169844 (44h2m9.145380573s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674772422 (44h2m9.145983151s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675359480 (44h2m9.146570219s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675987596 (44h2m9.147198335s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:33.888855747 (44h2m10.360066487s) [upload=38726]: Next returned nil segment Dec 5 12:57:33.888874513 (44h2m10.360085252s) [upload=38726]: Waiting for error group managing segments... Dec 5 12:57:34.458992275 (44h2m10.930203034s) [noise=true , address=81.171.14.70:4036 , piece_id=G67IW7YF7VX5GRSOUEJECEN66A5HMVZAGCNOEMJ6J76Q3WQCJDBQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.463924437 (44h2m10.935135166s) [noise=true , address=81.171.14.70:4042 , piece_id=V2B6EAOBLNVENCOKBKQHCU5ZAE2L33LSAUSMFCWPXBRSFGS5W7PQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.466804100 (44h2m10.938014849s) [noise=true , address=81.171.14.70:4028 , piece_id=ZQXS4NQTFFY2NJLE6E2CMHFOEVXKXTE5B7WC6EHQNOLZQLBF43KA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.482112661 (44h2m10.9533234s) [noise=true , address=81.171.14.70:4047 , piece_id=4G7U2PYPMWT7QHMFMKWDNIXKDQWPRQBR32R74MD6IOXTFOCGAMJQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.503767315 (44h2m10.974978044s) [noise=true , address=81.171.14.70:4026 , piece_id=6UGKVAGWTYIJ6PKDQOVGBN6TJMKKOT3XAJDJXL6VQ64RLX434Q2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.534018609 (44h2m11.005229339s) [noise=true , address=81.171.14.70:4039 , piece_id=GB3FEVE6G4SHK4VVFKEIH5FV43PGPGCV3BXUSZQQ6CGVTY6EY2MA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.926473649 (44h2m11.397684378s) [noise=true , address=81.171.14.70:4037 , piece_id=6ZNMEGPIZOYN4KQ4N3HKRA3ZTDOE3RQA4MK2BWS52LTN6G2UVTQA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.996303367 (44h2m11.467514097s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.099023697 (44h2m11.570234426s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.112701080 (44h2m11.583911819s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.148224273 (44h2m11.619435002s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.601076549 (44h2m43.072287288s) [noise=true , address=185.167.204.206:4072 , piece_id=GTEJKPFUP4OMHHPMGGNUYAOTRRPSKA7MNPRN5UANZCUCRUJCZQ6A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.858730070 (44h2m43.329940809s) [noise=true , address=185.167.204.205:4013 , piece_id=AWU4445M6HGFROHD7ZON7LF4XHHDBWNGYQ5OBTWRT6ZG7NKIQYPQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.984091582 (44h2m43.455302321s) [noise=true , address=185.167.204.205:4026 , piece_id=4QUQNQEML7X3MWDT3BW2V6HVKMEB34HY5ZOCGJTD4LDH7TOABC4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.997908141 (44h2m43.46911888s) [noise=true , address=185.167.204.205:4027 , piece_id=XE55BFKL5EEYCUI6F3CG2OMHWXTVPADE6N2BIEFODT77MVXUPTKA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:07.704382372 (44h2m44.175593111s) [noise=true , address=185.167.204.206:4052 , piece_id=JV4GC5Y3HXU44FVMMZZDHMN5LD6AK4SO3236KBKKZEZJQ3VOMHLQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:08.306751277 (44h2m44.777962016s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:09.728807001 (44h2m46.20001773s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:10.200462412 (44h2m46.671673151s) [noise=true , address=185.167.204.206:4043 , piece_id=ENHMBBAPVWOYLWG6S2AB75MWWY65ZMWVFGT6LQR6OOH6AMBAANGA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:11.218612754 (44h2m47.689823493s) [noise=true , address=185.167.204.205:4030 , piece_id=JBKFARJUDMQFJIUND5IQTHLCNHQVYHR4P5XOQK24RCDCERC5X72A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:22.049936661 (44h2m58.52114739s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:23.835508896 (44h3m0.306719625s) [noise=true , address=185.167.204.206:4056 , piece_id=GEVQRJW4TE7XTCGJX5HVUSBIKML5ESGM5NWVVDU7ELANJRRT4W5Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:26.013124099 (44h3m2.484334839s) [noise=true , address=185.167.204.206:4041 , piece_id=TOGP35PMCLIUVYB4J6N64ARHRMHKVKQE2IONNQEW32KCPNQYPL2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:27.982649379 (44h3m4.453860109s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:31.996355435 (44h3m8.467566194s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; close tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996542821 (44h3m8.46775356s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996709960 (44h3m8.467920699s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Dec 5 12:58:31.996823235 (44h3m8.468033974s) [noise=true , address=185.167.204.205:4002 , piece_id=4CRJ6ZV5WOJVT7WCEGZHU5HQ56VXZXJ4RB4IBLTRC6CPUQTFOLRA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996866238 (44h3m8.468076977s) [seg_pos={0 0}, upload=38726]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Dec 5 12:58:32.172198764 (44h3m8.643409493s) [upload=38726]: Done uploading segments... Dec 5 12:58:32.172234372 (44h3m8.643445101s) [upload=38726]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.600369733s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 7.238106944s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:17:22 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 7.238136439s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 29 out of 60 is failed (threshold=6) [..........XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXXXX.X..X] duration: 5.001670337s trace: https://jaeger.dev.storj.io/trace/11de9db10dd346cc FAIL (2025-12-05 13:17:16 UTC) orbiter warning: context deadline exceeded Duration: 5.001683391s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 13.230590506s trace: https://jaeger.dev.storj.io/trace/70ddcc9c759b9c09 FAIL (2025-12-05 13:17:06 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 13.230622076s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.117488396s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:17:03 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.117520998s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 7.17643036s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:17:00 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 7.17646713s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.460235691s trace: https://jaeger.dev.storj.io/trace/16d0fd0d28b4b6f7 FAIL (2025-12-05 13:16:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.667348134 (44h2m9.138558863s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.668113411 (44h2m9.13932414s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.669515572 (44h2m9.140726301s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670009011 (44h2m9.14121974s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670629353 (44h2m9.141840092s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670996271 (44h2m9.142207s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.671737944 (44h2m9.142948673s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674169844 (44h2m9.145380573s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674772422 (44h2m9.145983151s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675359480 (44h2m9.146570219s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675987596 (44h2m9.147198335s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:33.888855747 (44h2m10.360066487s) [upload=38726]: Next returned nil segment Dec 5 12:57:33.888874513 (44h2m10.360085252s) [upload=38726]: Waiting for error group managing segments... Dec 5 12:57:34.458992275 (44h2m10.930203034s) [noise=true , address=81.171.14.70:4036 , piece_id=G67IW7YF7VX5GRSOUEJECEN66A5HMVZAGCNOEMJ6J76Q3WQCJDBQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.463924437 (44h2m10.935135166s) [noise=true , address=81.171.14.70:4042 , piece_id=V2B6EAOBLNVENCOKBKQHCU5ZAE2L33LSAUSMFCWPXBRSFGS5W7PQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.466804100 (44h2m10.938014849s) [noise=true , address=81.171.14.70:4028 , piece_id=ZQXS4NQTFFY2NJLE6E2CMHFOEVXKXTE5B7WC6EHQNOLZQLBF43KA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.482112661 (44h2m10.9533234s) [noise=true , address=81.171.14.70:4047 , piece_id=4G7U2PYPMWT7QHMFMKWDNIXKDQWPRQBR32R74MD6IOXTFOCGAMJQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.503767315 (44h2m10.974978044s) [noise=true , address=81.171.14.70:4026 , piece_id=6UGKVAGWTYIJ6PKDQOVGBN6TJMKKOT3XAJDJXL6VQ64RLX434Q2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.534018609 (44h2m11.005229339s) [noise=true , address=81.171.14.70:4039 , piece_id=GB3FEVE6G4SHK4VVFKEIH5FV43PGPGCV3BXUSZQQ6CGVTY6EY2MA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.926473649 (44h2m11.397684378s) [noise=true , address=81.171.14.70:4037 , piece_id=6ZNMEGPIZOYN4KQ4N3HKRA3ZTDOE3RQA4MK2BWS52LTN6G2UVTQA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.996303367 (44h2m11.467514097s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.099023697 (44h2m11.570234426s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.112701080 (44h2m11.583911819s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.148224273 (44h2m11.619435002s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.601076549 (44h2m43.072287288s) [noise=true , address=185.167.204.206:4072 , piece_id=GTEJKPFUP4OMHHPMGGNUYAOTRRPSKA7MNPRN5UANZCUCRUJCZQ6A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.858730070 (44h2m43.329940809s) [noise=true , address=185.167.204.205:4013 , piece_id=AWU4445M6HGFROHD7ZON7LF4XHHDBWNGYQ5OBTWRT6ZG7NKIQYPQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.984091582 (44h2m43.455302321s) [noise=true , address=185.167.204.205:4026 , piece_id=4QUQNQEML7X3MWDT3BW2V6HVKMEB34HY5ZOCGJTD4LDH7TOABC4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.997908141 (44h2m43.46911888s) [noise=true , address=185.167.204.205:4027 , piece_id=XE55BFKL5EEYCUI6F3CG2OMHWXTVPADE6N2BIEFODT77MVXUPTKA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:07.704382372 (44h2m44.175593111s) [noise=true , address=185.167.204.206:4052 , piece_id=JV4GC5Y3HXU44FVMMZZDHMN5LD6AK4SO3236KBKKZEZJQ3VOMHLQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:08.306751277 (44h2m44.777962016s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:09.728807001 (44h2m46.20001773s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:10.200462412 (44h2m46.671673151s) [noise=true , address=185.167.204.206:4043 , piece_id=ENHMBBAPVWOYLWG6S2AB75MWWY65ZMWVFGT6LQR6OOH6AMBAANGA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:11.218612754 (44h2m47.689823493s) [noise=true , address=185.167.204.205:4030 , piece_id=JBKFARJUDMQFJIUND5IQTHLCNHQVYHR4P5XOQK24RCDCERC5X72A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:22.049936661 (44h2m58.52114739s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:23.835508896 (44h3m0.306719625s) [noise=true , address=185.167.204.206:4056 , piece_id=GEVQRJW4TE7XTCGJX5HVUSBIKML5ESGM5NWVVDU7ELANJRRT4W5Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:26.013124099 (44h3m2.484334839s) [noise=true , address=185.167.204.206:4041 , piece_id=TOGP35PMCLIUVYB4J6N64ARHRMHKVKQE2IONNQEW32KCPNQYPL2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:27.982649379 (44h3m4.453860109s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:31.996355435 (44h3m8.467566194s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; close tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996542821 (44h3m8.46775356s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996709960 (44h3m8.467920699s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Dec 5 12:58:31.996823235 (44h3m8.468033974s) [noise=true , address=185.167.204.205:4002 , piece_id=4CRJ6ZV5WOJVT7WCEGZHU5HQ56VXZXJ4RB4IBLTRC6CPUQTFOLRA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996866238 (44h3m8.468076977s) [seg_pos={0 0}, upload=38726]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Dec 5 12:58:32.172198764 (44h3m8.643409493s) [upload=38726]: Done uploading segments... Dec 5 12:58:32.172234372 (44h3m8.643445101s) [upload=38726]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.46026673s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.046006758s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:16:47 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.046034581s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.216933305s trace: https://jaeger.dev.storj.io/trace/16d0fd0d28b4b6f7 FAIL (2025-12-05 13:16:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.667348134 (44h2m9.138558863s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.668113411 (44h2m9.13932414s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.669515572 (44h2m9.140726301s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670009011 (44h2m9.14121974s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670629353 (44h2m9.141840092s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670996271 (44h2m9.142207s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.671737944 (44h2m9.142948673s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674169844 (44h2m9.145380573s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674772422 (44h2m9.145983151s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675359480 (44h2m9.146570219s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675987596 (44h2m9.147198335s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:33.888855747 (44h2m10.360066487s) [upload=38726]: Next returned nil segment Dec 5 12:57:33.888874513 (44h2m10.360085252s) [upload=38726]: Waiting for error group managing segments... Dec 5 12:57:34.458992275 (44h2m10.930203034s) [noise=true , address=81.171.14.70:4036 , piece_id=G67IW7YF7VX5GRSOUEJECEN66A5HMVZAGCNOEMJ6J76Q3WQCJDBQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.463924437 (44h2m10.935135166s) [noise=true , address=81.171.14.70:4042 , piece_id=V2B6EAOBLNVENCOKBKQHCU5ZAE2L33LSAUSMFCWPXBRSFGS5W7PQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.466804100 (44h2m10.938014849s) [noise=true , address=81.171.14.70:4028 , piece_id=ZQXS4NQTFFY2NJLE6E2CMHFOEVXKXTE5B7WC6EHQNOLZQLBF43KA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.482112661 (44h2m10.9533234s) [noise=true , address=81.171.14.70:4047 , piece_id=4G7U2PYPMWT7QHMFMKWDNIXKDQWPRQBR32R74MD6IOXTFOCGAMJQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.503767315 (44h2m10.974978044s) [noise=true , address=81.171.14.70:4026 , piece_id=6UGKVAGWTYIJ6PKDQOVGBN6TJMKKOT3XAJDJXL6VQ64RLX434Q2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.534018609 (44h2m11.005229339s) [noise=true , address=81.171.14.70:4039 , piece_id=GB3FEVE6G4SHK4VVFKEIH5FV43PGPGCV3BXUSZQQ6CGVTY6EY2MA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.926473649 (44h2m11.397684378s) [noise=true , address=81.171.14.70:4037 , piece_id=6ZNMEGPIZOYN4KQ4N3HKRA3ZTDOE3RQA4MK2BWS52LTN6G2UVTQA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.996303367 (44h2m11.467514097s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.099023697 (44h2m11.570234426s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.112701080 (44h2m11.583911819s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.148224273 (44h2m11.619435002s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.601076549 (44h2m43.072287288s) [noise=true , address=185.167.204.206:4072 , piece_id=GTEJKPFUP4OMHHPMGGNUYAOTRRPSKA7MNPRN5UANZCUCRUJCZQ6A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.858730070 (44h2m43.329940809s) [noise=true , address=185.167.204.205:4013 , piece_id=AWU4445M6HGFROHD7ZON7LF4XHHDBWNGYQ5OBTWRT6ZG7NKIQYPQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.984091582 (44h2m43.455302321s) [noise=true , address=185.167.204.205:4026 , piece_id=4QUQNQEML7X3MWDT3BW2V6HVKMEB34HY5ZOCGJTD4LDH7TOABC4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.997908141 (44h2m43.46911888s) [noise=true , address=185.167.204.205:4027 , piece_id=XE55BFKL5EEYCUI6F3CG2OMHWXTVPADE6N2BIEFODT77MVXUPTKA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:07.704382372 (44h2m44.175593111s) [noise=true , address=185.167.204.206:4052 , piece_id=JV4GC5Y3HXU44FVMMZZDHMN5LD6AK4SO3236KBKKZEZJQ3VOMHLQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:08.306751277 (44h2m44.777962016s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:09.728807001 (44h2m46.20001773s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:10.200462412 (44h2m46.671673151s) [noise=true , address=185.167.204.206:4043 , piece_id=ENHMBBAPVWOYLWG6S2AB75MWWY65ZMWVFGT6LQR6OOH6AMBAANGA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:11.218612754 (44h2m47.689823493s) [noise=true , address=185.167.204.205:4030 , piece_id=JBKFARJUDMQFJIUND5IQTHLCNHQVYHR4P5XOQK24RCDCERC5X72A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:22.049936661 (44h2m58.52114739s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:23.835508896 (44h3m0.306719625s) [noise=true , address=185.167.204.206:4056 , piece_id=GEVQRJW4TE7XTCGJX5HVUSBIKML5ESGM5NWVVDU7ELANJRRT4W5Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:26.013124099 (44h3m2.484334839s) [noise=true , address=185.167.204.206:4041 , piece_id=TOGP35PMCLIUVYB4J6N64ARHRMHKVKQE2IONNQEW32KCPNQYPL2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:27.982649379 (44h3m4.453860109s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:31.996355435 (44h3m8.467566194s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; close tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996542821 (44h3m8.46775356s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996709960 (44h3m8.467920699s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Dec 5 12:58:31.996823235 (44h3m8.468033974s) [noise=true , address=185.167.204.205:4002 , piece_id=4CRJ6ZV5WOJVT7WCEGZHU5HQ56VXZXJ4RB4IBLTRC6CPUQTFOLRA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996866238 (44h3m8.468076977s) [seg_pos={0 0}, upload=38726]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Dec 5 12:58:32.172198764 (44h3m8.643409493s) [upload=38726]: Done uploading segments... Dec 5 12:58:32.172234372 (44h3m8.643445101s) [upload=38726]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.216995193s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 16.576482845s trace: https://jaeger.dev.storj.io/trace/70ddcc9c759b9c09 FAIL (2025-12-05 13:16:21 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 16.57651131s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 28 out of 60 is failed (threshold=6) [...........XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXXXX.X..] duration: 5.000698174s trace: https://jaeger.dev.storj.io/trace/16d64ab135c07990 FAIL (2025-12-05 13:16:07 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000729304s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.234560773s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:15:58 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.234586671s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 7.185979862s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:15:56 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 7.186008155s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 28 out of 60 is failed (threshold=6) [............XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXXXX.X.] duration: 5.00130923s trace: https://jaeger.dev.storj.io/trace/16d64ab135c07990 FAIL (2025-12-05 13:15:46 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001349018s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.838092635s trace: https://jaeger.dev.storj.io/trace/16d0fd0d28b4b6f7 FAIL (2025-12-05 13:15:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.667348134 (44h2m9.138558863s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.668113411 (44h2m9.13932414s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.669515572 (44h2m9.140726301s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670009011 (44h2m9.14121974s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670629353 (44h2m9.141840092s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670996271 (44h2m9.142207s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.671737944 (44h2m9.142948673s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674169844 (44h2m9.145380573s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674772422 (44h2m9.145983151s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675359480 (44h2m9.146570219s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675987596 (44h2m9.147198335s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:33.888855747 (44h2m10.360066487s) [upload=38726]: Next returned nil segment Dec 5 12:57:33.888874513 (44h2m10.360085252s) [upload=38726]: Waiting for error group managing segments... Dec 5 12:57:34.458992275 (44h2m10.930203034s) [noise=true , address=81.171.14.70:4036 , piece_id=G67IW7YF7VX5GRSOUEJECEN66A5HMVZAGCNOEMJ6J76Q3WQCJDBQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.463924437 (44h2m10.935135166s) [noise=true , address=81.171.14.70:4042 , piece_id=V2B6EAOBLNVENCOKBKQHCU5ZAE2L33LSAUSMFCWPXBRSFGS5W7PQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.466804100 (44h2m10.938014849s) [noise=true , address=81.171.14.70:4028 , piece_id=ZQXS4NQTFFY2NJLE6E2CMHFOEVXKXTE5B7WC6EHQNOLZQLBF43KA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.482112661 (44h2m10.9533234s) [noise=true , address=81.171.14.70:4047 , piece_id=4G7U2PYPMWT7QHMFMKWDNIXKDQWPRQBR32R74MD6IOXTFOCGAMJQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.503767315 (44h2m10.974978044s) [noise=true , address=81.171.14.70:4026 , piece_id=6UGKVAGWTYIJ6PKDQOVGBN6TJMKKOT3XAJDJXL6VQ64RLX434Q2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.534018609 (44h2m11.005229339s) [noise=true , address=81.171.14.70:4039 , piece_id=GB3FEVE6G4SHK4VVFKEIH5FV43PGPGCV3BXUSZQQ6CGVTY6EY2MA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.926473649 (44h2m11.397684378s) [noise=true , address=81.171.14.70:4037 , piece_id=6ZNMEGPIZOYN4KQ4N3HKRA3ZTDOE3RQA4MK2BWS52LTN6G2UVTQA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.996303367 (44h2m11.467514097s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.099023697 (44h2m11.570234426s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.112701080 (44h2m11.583911819s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.148224273 (44h2m11.619435002s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.601076549 (44h2m43.072287288s) [noise=true , address=185.167.204.206:4072 , piece_id=GTEJKPFUP4OMHHPMGGNUYAOTRRPSKA7MNPRN5UANZCUCRUJCZQ6A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.858730070 (44h2m43.329940809s) [noise=true , address=185.167.204.205:4013 , piece_id=AWU4445M6HGFROHD7ZON7LF4XHHDBWNGYQ5OBTWRT6ZG7NKIQYPQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.984091582 (44h2m43.455302321s) [noise=true , address=185.167.204.205:4026 , piece_id=4QUQNQEML7X3MWDT3BW2V6HVKMEB34HY5ZOCGJTD4LDH7TOABC4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.997908141 (44h2m43.46911888s) [noise=true , address=185.167.204.205:4027 , piece_id=XE55BFKL5EEYCUI6F3CG2OMHWXTVPADE6N2BIEFODT77MVXUPTKA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:07.704382372 (44h2m44.175593111s) [noise=true , address=185.167.204.206:4052 , piece_id=JV4GC5Y3HXU44FVMMZZDHMN5LD6AK4SO3236KBKKZEZJQ3VOMHLQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:08.306751277 (44h2m44.777962016s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:09.728807001 (44h2m46.20001773s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:10.200462412 (44h2m46.671673151s) [noise=true , address=185.167.204.206:4043 , piece_id=ENHMBBAPVWOYLWG6S2AB75MWWY65ZMWVFGT6LQR6OOH6AMBAANGA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:11.218612754 (44h2m47.689823493s) [noise=true , address=185.167.204.205:4030 , piece_id=JBKFARJUDMQFJIUND5IQTHLCNHQVYHR4P5XOQK24RCDCERC5X72A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:22.049936661 (44h2m58.52114739s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:23.835508896 (44h3m0.306719625s) [noise=true , address=185.167.204.206:4056 , piece_id=GEVQRJW4TE7XTCGJX5HVUSBIKML5ESGM5NWVVDU7ELANJRRT4W5Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:26.013124099 (44h3m2.484334839s) [noise=true , address=185.167.204.206:4041 , piece_id=TOGP35PMCLIUVYB4J6N64ARHRMHKVKQE2IONNQEW32KCPNQYPL2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:27.982649379 (44h3m4.453860109s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:31.996355435 (44h3m8.467566194s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; close tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996542821 (44h3m8.46775356s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996709960 (44h3m8.467920699s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Dec 5 12:58:31.996823235 (44h3m8.468033974s) [noise=true , address=185.167.204.205:4002 , piece_id=4CRJ6ZV5WOJVT7WCEGZHU5HQ56VXZXJ4RB4IBLTRC6CPUQTFOLRA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996866238 (44h3m8.468076977s) [seg_pos={0 0}, upload=38726]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Dec 5 12:58:32.172198764 (44h3m8.643409493s) [upload=38726]: Done uploading segments... Dec 5 12:58:32.172234372 (44h3m8.643445101s) [upload=38726]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.838122532s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001930955s trace: https://jaeger.dev.storj.io/trace/70ddcc9c759b9c09 FAIL (2025-12-05 13:15:38 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001956193s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 8.327244898s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:15:21 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 8.327278052s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 28 out of 60 is failed (threshold=6) [.............XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXXXX.X] duration: 5.001685554s trace: https://jaeger.dev.storj.io/trace/16d64ab135c07990 FAIL (2025-12-05 13:15:14 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001709608s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.02549977s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:15:09 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.025657279s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 7.033412328s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:15:02 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 7.033436885s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 27 out of 60 is failed (threshold=6) [..............XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXXXX.] duration: 5.001263722s trace: https://jaeger.dev.storj.io/trace/7d269ccdc0513774 FAIL (2025-12-05 13:14:56 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001289161s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.239888257s trace: https://jaeger.dev.storj.io/trace/16d0fd0d28b4b6f7 FAIL (2025-12-05 13:14:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.667348134 (44h2m9.138558863s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.668113411 (44h2m9.13932414s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.669515572 (44h2m9.140726301s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670009011 (44h2m9.14121974s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670629353 (44h2m9.141840092s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670996271 (44h2m9.142207s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.671737944 (44h2m9.142948673s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674169844 (44h2m9.145380573s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674772422 (44h2m9.145983151s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675359480 (44h2m9.146570219s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675987596 (44h2m9.147198335s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:33.888855747 (44h2m10.360066487s) [upload=38726]: Next returned nil segment Dec 5 12:57:33.888874513 (44h2m10.360085252s) [upload=38726]: Waiting for error group managing segments... Dec 5 12:57:34.458992275 (44h2m10.930203034s) [noise=true , address=81.171.14.70:4036 , piece_id=G67IW7YF7VX5GRSOUEJECEN66A5HMVZAGCNOEMJ6J76Q3WQCJDBQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.463924437 (44h2m10.935135166s) [noise=true , address=81.171.14.70:4042 , piece_id=V2B6EAOBLNVENCOKBKQHCU5ZAE2L33LSAUSMFCWPXBRSFGS5W7PQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.466804100 (44h2m10.938014849s) [noise=true , address=81.171.14.70:4028 , piece_id=ZQXS4NQTFFY2NJLE6E2CMHFOEVXKXTE5B7WC6EHQNOLZQLBF43KA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.482112661 (44h2m10.9533234s) [noise=true , address=81.171.14.70:4047 , piece_id=4G7U2PYPMWT7QHMFMKWDNIXKDQWPRQBR32R74MD6IOXTFOCGAMJQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.503767315 (44h2m10.974978044s) [noise=true , address=81.171.14.70:4026 , piece_id=6UGKVAGWTYIJ6PKDQOVGBN6TJMKKOT3XAJDJXL6VQ64RLX434Q2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.534018609 (44h2m11.005229339s) [noise=true , address=81.171.14.70:4039 , piece_id=GB3FEVE6G4SHK4VVFKEIH5FV43PGPGCV3BXUSZQQ6CGVTY6EY2MA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.926473649 (44h2m11.397684378s) [noise=true , address=81.171.14.70:4037 , piece_id=6ZNMEGPIZOYN4KQ4N3HKRA3ZTDOE3RQA4MK2BWS52LTN6G2UVTQA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.996303367 (44h2m11.467514097s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.099023697 (44h2m11.570234426s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.112701080 (44h2m11.583911819s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.148224273 (44h2m11.619435002s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.601076549 (44h2m43.072287288s) [noise=true , address=185.167.204.206:4072 , piece_id=GTEJKPFUP4OMHHPMGGNUYAOTRRPSKA7MNPRN5UANZCUCRUJCZQ6A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.858730070 (44h2m43.329940809s) [noise=true , address=185.167.204.205:4013 , piece_id=AWU4445M6HGFROHD7ZON7LF4XHHDBWNGYQ5OBTWRT6ZG7NKIQYPQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.984091582 (44h2m43.455302321s) [noise=true , address=185.167.204.205:4026 , piece_id=4QUQNQEML7X3MWDT3BW2V6HVKMEB34HY5ZOCGJTD4LDH7TOABC4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.997908141 (44h2m43.46911888s) [noise=true , address=185.167.204.205:4027 , piece_id=XE55BFKL5EEYCUI6F3CG2OMHWXTVPADE6N2BIEFODT77MVXUPTKA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:07.704382372 (44h2m44.175593111s) [noise=true , address=185.167.204.206:4052 , piece_id=JV4GC5Y3HXU44FVMMZZDHMN5LD6AK4SO3236KBKKZEZJQ3VOMHLQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:08.306751277 (44h2m44.777962016s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:09.728807001 (44h2m46.20001773s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:10.200462412 (44h2m46.671673151s) [noise=true , address=185.167.204.206:4043 , piece_id=ENHMBBAPVWOYLWG6S2AB75MWWY65ZMWVFGT6LQR6OOH6AMBAANGA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:11.218612754 (44h2m47.689823493s) [noise=true , address=185.167.204.205:4030 , piece_id=JBKFARJUDMQFJIUND5IQTHLCNHQVYHR4P5XOQK24RCDCERC5X72A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:22.049936661 (44h2m58.52114739s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:23.835508896 (44h3m0.306719625s) [noise=true , address=185.167.204.206:4056 , piece_id=GEVQRJW4TE7XTCGJX5HVUSBIKML5ESGM5NWVVDU7ELANJRRT4W5Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:26.013124099 (44h3m2.484334839s) [noise=true , address=185.167.204.206:4041 , piece_id=TOGP35PMCLIUVYB4J6N64ARHRMHKVKQE2IONNQEW32KCPNQYPL2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:27.982649379 (44h3m4.453860109s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:31.996355435 (44h3m8.467566194s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; close tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996542821 (44h3m8.46775356s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996709960 (44h3m8.467920699s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Dec 5 12:58:31.996823235 (44h3m8.468033974s) [noise=true , address=185.167.204.205:4002 , piece_id=4CRJ6ZV5WOJVT7WCEGZHU5HQ56VXZXJ4RB4IBLTRC6CPUQTFOLRA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996866238 (44h3m8.468076977s) [seg_pos={0 0}, upload=38726]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Dec 5 12:58:32.172198764 (44h3m8.643409493s) [upload=38726]: Done uploading segments... Dec 5 12:58:32.172234372 (44h3m8.643445101s) [upload=38726]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.239939935s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 7.068623504s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:14:33 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 7.068654003s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 28 out of 60 is failed (threshold=6) [X..............XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXXXX] duration: 5.001479821s trace: https://jaeger.dev.storj.io/trace/7d269ccdc0513774 FAIL (2025-12-05 13:14:03 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001506112s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.249350536s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:14:00 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.249377006s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.365227677s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:13:43 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.365256381s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.349347058s trace: https://jaeger.dev.storj.io/trace/16d0fd0d28b4b6f7 FAIL (2025-12-05 13:13:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.667348134 (44h2m9.138558863s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.668113411 (44h2m9.13932414s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.669515572 (44h2m9.140726301s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670009011 (44h2m9.14121974s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670629353 (44h2m9.141840092s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670996271 (44h2m9.142207s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.671737944 (44h2m9.142948673s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674169844 (44h2m9.145380573s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674772422 (44h2m9.145983151s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675359480 (44h2m9.146570219s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675987596 (44h2m9.147198335s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:33.888855747 (44h2m10.360066487s) [upload=38726]: Next returned nil segment Dec 5 12:57:33.888874513 (44h2m10.360085252s) [upload=38726]: Waiting for error group managing segments... Dec 5 12:57:34.458992275 (44h2m10.930203034s) [noise=true , address=81.171.14.70:4036 , piece_id=G67IW7YF7VX5GRSOUEJECEN66A5HMVZAGCNOEMJ6J76Q3WQCJDBQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.463924437 (44h2m10.935135166s) [noise=true , address=81.171.14.70:4042 , piece_id=V2B6EAOBLNVENCOKBKQHCU5ZAE2L33LSAUSMFCWPXBRSFGS5W7PQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.466804100 (44h2m10.938014849s) [noise=true , address=81.171.14.70:4028 , piece_id=ZQXS4NQTFFY2NJLE6E2CMHFOEVXKXTE5B7WC6EHQNOLZQLBF43KA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.482112661 (44h2m10.9533234s) [noise=true , address=81.171.14.70:4047 , piece_id=4G7U2PYPMWT7QHMFMKWDNIXKDQWPRQBR32R74MD6IOXTFOCGAMJQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.503767315 (44h2m10.974978044s) [noise=true , address=81.171.14.70:4026 , piece_id=6UGKVAGWTYIJ6PKDQOVGBN6TJMKKOT3XAJDJXL6VQ64RLX434Q2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.534018609 (44h2m11.005229339s) [noise=true , address=81.171.14.70:4039 , piece_id=GB3FEVE6G4SHK4VVFKEIH5FV43PGPGCV3BXUSZQQ6CGVTY6EY2MA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.926473649 (44h2m11.397684378s) [noise=true , address=81.171.14.70:4037 , piece_id=6ZNMEGPIZOYN4KQ4N3HKRA3ZTDOE3RQA4MK2BWS52LTN6G2UVTQA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.996303367 (44h2m11.467514097s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.099023697 (44h2m11.570234426s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.112701080 (44h2m11.583911819s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.148224273 (44h2m11.619435002s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.601076549 (44h2m43.072287288s) [noise=true , address=185.167.204.206:4072 , piece_id=GTEJKPFUP4OMHHPMGGNUYAOTRRPSKA7MNPRN5UANZCUCRUJCZQ6A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.858730070 (44h2m43.329940809s) [noise=true , address=185.167.204.205:4013 , piece_id=AWU4445M6HGFROHD7ZON7LF4XHHDBWNGYQ5OBTWRT6ZG7NKIQYPQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.984091582 (44h2m43.455302321s) [noise=true , address=185.167.204.205:4026 , piece_id=4QUQNQEML7X3MWDT3BW2V6HVKMEB34HY5ZOCGJTD4LDH7TOABC4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.997908141 (44h2m43.46911888s) [noise=true , address=185.167.204.205:4027 , piece_id=XE55BFKL5EEYCUI6F3CG2OMHWXTVPADE6N2BIEFODT77MVXUPTKA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:07.704382372 (44h2m44.175593111s) [noise=true , address=185.167.204.206:4052 , piece_id=JV4GC5Y3HXU44FVMMZZDHMN5LD6AK4SO3236KBKKZEZJQ3VOMHLQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:08.306751277 (44h2m44.777962016s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:09.728807001 (44h2m46.20001773s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:10.200462412 (44h2m46.671673151s) [noise=true , address=185.167.204.206:4043 , piece_id=ENHMBBAPVWOYLWG6S2AB75MWWY65ZMWVFGT6LQR6OOH6AMBAANGA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:11.218612754 (44h2m47.689823493s) [noise=true , address=185.167.204.205:4030 , piece_id=JBKFARJUDMQFJIUND5IQTHLCNHQVYHR4P5XOQK24RCDCERC5X72A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:22.049936661 (44h2m58.52114739s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:23.835508896 (44h3m0.306719625s) [noise=true , address=185.167.204.206:4056 , piece_id=GEVQRJW4TE7XTCGJX5HVUSBIKML5ESGM5NWVVDU7ELANJRRT4W5Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:26.013124099 (44h3m2.484334839s) [noise=true , address=185.167.204.206:4041 , piece_id=TOGP35PMCLIUVYB4J6N64ARHRMHKVKQE2IONNQEW32KCPNQYPL2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:27.982649379 (44h3m4.453860109s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:31.996355435 (44h3m8.467566194s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; close tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996542821 (44h3m8.46775356s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996709960 (44h3m8.467920699s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Dec 5 12:58:31.996823235 (44h3m8.468033974s) [noise=true , address=185.167.204.205:4002 , piece_id=4CRJ6ZV5WOJVT7WCEGZHU5HQ56VXZXJ4RB4IBLTRC6CPUQTFOLRA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996866238 (44h3m8.468076977s) [seg_pos={0 0}, upload=38726]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Dec 5 12:58:32.172198764 (44h3m8.643409493s) [upload=38726]: Done uploading segments... Dec 5 12:58:32.172234372 (44h3m8.643445101s) [upload=38726]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.349376734s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 8.304800567s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:13:20 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 8.304829973s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 27 out of 60 is failed (threshold=6) [.X..............XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXXX] duration: 5.001107406s trace: https://jaeger.dev.storj.io/trace/16e81480be461d33 FAIL (2025-12-05 13:13:07 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001136322s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.601321056s trace: https://jaeger.dev.storj.io/trace/16d0fd0d28b4b6f7 FAIL (2025-12-05 13:13:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.667348134 (44h2m9.138558863s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.668113411 (44h2m9.13932414s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.669515572 (44h2m9.140726301s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670009011 (44h2m9.14121974s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670629353 (44h2m9.141840092s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670996271 (44h2m9.142207s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.671737944 (44h2m9.142948673s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674169844 (44h2m9.145380573s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674772422 (44h2m9.145983151s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675359480 (44h2m9.146570219s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675987596 (44h2m9.147198335s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:33.888855747 (44h2m10.360066487s) [upload=38726]: Next returned nil segment Dec 5 12:57:33.888874513 (44h2m10.360085252s) [upload=38726]: Waiting for error group managing segments... Dec 5 12:57:34.458992275 (44h2m10.930203034s) [noise=true , address=81.171.14.70:4036 , piece_id=G67IW7YF7VX5GRSOUEJECEN66A5HMVZAGCNOEMJ6J76Q3WQCJDBQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.463924437 (44h2m10.935135166s) [noise=true , address=81.171.14.70:4042 , piece_id=V2B6EAOBLNVENCOKBKQHCU5ZAE2L33LSAUSMFCWPXBRSFGS5W7PQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.466804100 (44h2m10.938014849s) [noise=true , address=81.171.14.70:4028 , piece_id=ZQXS4NQTFFY2NJLE6E2CMHFOEVXKXTE5B7WC6EHQNOLZQLBF43KA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.482112661 (44h2m10.9533234s) [noise=true , address=81.171.14.70:4047 , piece_id=4G7U2PYPMWT7QHMFMKWDNIXKDQWPRQBR32R74MD6IOXTFOCGAMJQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.503767315 (44h2m10.974978044s) [noise=true , address=81.171.14.70:4026 , piece_id=6UGKVAGWTYIJ6PKDQOVGBN6TJMKKOT3XAJDJXL6VQ64RLX434Q2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.534018609 (44h2m11.005229339s) [noise=true , address=81.171.14.70:4039 , piece_id=GB3FEVE6G4SHK4VVFKEIH5FV43PGPGCV3BXUSZQQ6CGVTY6EY2MA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.926473649 (44h2m11.397684378s) [noise=true , address=81.171.14.70:4037 , piece_id=6ZNMEGPIZOYN4KQ4N3HKRA3ZTDOE3RQA4MK2BWS52LTN6G2UVTQA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.996303367 (44h2m11.467514097s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.099023697 (44h2m11.570234426s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.112701080 (44h2m11.583911819s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.148224273 (44h2m11.619435002s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.601076549 (44h2m43.072287288s) [noise=true , address=185.167.204.206:4072 , piece_id=GTEJKPFUP4OMHHPMGGNUYAOTRRPSKA7MNPRN5UANZCUCRUJCZQ6A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.858730070 (44h2m43.329940809s) [noise=true , address=185.167.204.205:4013 , piece_id=AWU4445M6HGFROHD7ZON7LF4XHHDBWNGYQ5OBTWRT6ZG7NKIQYPQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.984091582 (44h2m43.455302321s) [noise=true , address=185.167.204.205:4026 , piece_id=4QUQNQEML7X3MWDT3BW2V6HVKMEB34HY5ZOCGJTD4LDH7TOABC4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.997908141 (44h2m43.46911888s) [noise=true , address=185.167.204.205:4027 , piece_id=XE55BFKL5EEYCUI6F3CG2OMHWXTVPADE6N2BIEFODT77MVXUPTKA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:07.704382372 (44h2m44.175593111s) [noise=true , address=185.167.204.206:4052 , piece_id=JV4GC5Y3HXU44FVMMZZDHMN5LD6AK4SO3236KBKKZEZJQ3VOMHLQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:08.306751277 (44h2m44.777962016s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:09.728807001 (44h2m46.20001773s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:10.200462412 (44h2m46.671673151s) [noise=true , address=185.167.204.206:4043 , piece_id=ENHMBBAPVWOYLWG6S2AB75MWWY65ZMWVFGT6LQR6OOH6AMBAANGA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:11.218612754 (44h2m47.689823493s) [noise=true , address=185.167.204.205:4030 , piece_id=JBKFARJUDMQFJIUND5IQTHLCNHQVYHR4P5XOQK24RCDCERC5X72A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:22.049936661 (44h2m58.52114739s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:23.835508896 (44h3m0.306719625s) [noise=true , address=185.167.204.206:4056 , piece_id=GEVQRJW4TE7XTCGJX5HVUSBIKML5ESGM5NWVVDU7ELANJRRT4W5Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:26.013124099 (44h3m2.484334839s) [noise=true , address=185.167.204.206:4041 , piece_id=TOGP35PMCLIUVYB4J6N64ARHRMHKVKQE2IONNQEW32KCPNQYPL2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:27.982649379 (44h3m4.453860109s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:31.996355435 (44h3m8.467566194s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; close tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996542821 (44h3m8.46775356s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996709960 (44h3m8.467920699s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Dec 5 12:58:31.996823235 (44h3m8.468033974s) [noise=true , address=185.167.204.205:4002 , piece_id=4CRJ6ZV5WOJVT7WCEGZHU5HQ56VXZXJ4RB4IBLTRC6CPUQTFOLRA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996866238 (44h3m8.468076977s) [seg_pos={0 0}, upload=38726]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Dec 5 12:58:32.172198764 (44h3m8.643409493s) [upload=38726]: Done uploading segments... Dec 5 12:58:32.172234372 (44h3m8.643445101s) [upload=38726]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.601351904s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 7.562215086s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:12:59 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 7.562245254s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.325306873s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:12:35 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.325326651s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.165478361s trace: https://jaeger.dev.storj.io/trace/63fbf6b6cd5d03cb FAIL (2025-12-05 13:12:10 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 51) Duration: 5.165499561s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 7.410282373s trace: https://jaeger.dev.storj.io/trace/275a4a7f39135e2a FAIL (2025-12-05 13:12:08 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 45) Duration: 7.410311408s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.862950168s trace: https://jaeger.dev.storj.io/trace/16d0fd0d28b4b6f7 FAIL (2025-12-05 13:12:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.667348134 (44h2m9.138558863s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.668113411 (44h2m9.13932414s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.669515572 (44h2m9.140726301s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670009011 (44h2m9.14121974s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670629353 (44h2m9.141840092s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.670996271 (44h2m9.142207s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.671737944 (44h2m9.142948673s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674169844 (44h2m9.145380573s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.674772422 (44h2m9.145983151s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675359480 (44h2m9.146570219s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:32.675987596 (44h2m9.147198335s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Uploading piece... Dec 5 12:57:33.888855747 (44h2m10.360066487s) [upload=38726]: Next returned nil segment Dec 5 12:57:33.888874513 (44h2m10.360085252s) [upload=38726]: Waiting for error group managing segments... Dec 5 12:57:34.458992275 (44h2m10.930203034s) [noise=true , address=81.171.14.70:4036 , piece_id=G67IW7YF7VX5GRSOUEJECEN66A5HMVZAGCNOEMJ6J76Q3WQCJDBQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.463924437 (44h2m10.935135166s) [noise=true , address=81.171.14.70:4042 , piece_id=V2B6EAOBLNVENCOKBKQHCU5ZAE2L33LSAUSMFCWPXBRSFGS5W7PQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.466804100 (44h2m10.938014849s) [noise=true , address=81.171.14.70:4028 , piece_id=ZQXS4NQTFFY2NJLE6E2CMHFOEVXKXTE5B7WC6EHQNOLZQLBF43KA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.482112661 (44h2m10.9533234s) [noise=true , address=81.171.14.70:4047 , piece_id=4G7U2PYPMWT7QHMFMKWDNIXKDQWPRQBR32R74MD6IOXTFOCGAMJQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.503767315 (44h2m10.974978044s) [noise=true , address=81.171.14.70:4026 , piece_id=6UGKVAGWTYIJ6PKDQOVGBN6TJMKKOT3XAJDJXL6VQ64RLX434Q2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.534018609 (44h2m11.005229339s) [noise=true , address=81.171.14.70:4039 , piece_id=GB3FEVE6G4SHK4VVFKEIH5FV43PGPGCV3BXUSZQQ6CGVTY6EY2MA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.926473649 (44h2m11.397684378s) [noise=true , address=81.171.14.70:4037 , piece_id=6ZNMEGPIZOYN4KQ4N3HKRA3ZTDOE3RQA4MK2BWS52LTN6G2UVTQA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:34.996303367 (44h2m11.467514097s) [noise=true , address=81.171.14.70:4044 , piece_id=PLPPT6RYM734KYQ2NHOJ3PQRXCRZPVGLSFNKGTEDPDV2HUT4IV7Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.099023697 (44h2m11.570234426s) [noise=true , address=89.149.201.147:4021 , piece_id=Z6PYBMORPCESZXX3CUAJRANAJ64LTCO742BKUN3F2CBLZO3IC7DA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.112701080 (44h2m11.583911819s) [noise=true , address=89.149.201.147:4024 , piece_id=FBE2CRSK46LOBYES62HZEIJD6UGK7XJMJP24J6XLAGZUKNEK2ZKQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:57:35.148224273 (44h2m11.619435002s) [noise=true , address=89.149.201.147:4018 , piece_id=WBLQVRRTKGEJJ75ZPWN7CXK65K5ZXOVH6QTIGY34RL35EZS3G73Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.601076549 (44h2m43.072287288s) [noise=true , address=185.167.204.206:4072 , piece_id=GTEJKPFUP4OMHHPMGGNUYAOTRRPSKA7MNPRN5UANZCUCRUJCZQ6A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.858730070 (44h2m43.329940809s) [noise=true , address=185.167.204.205:4013 , piece_id=AWU4445M6HGFROHD7ZON7LF4XHHDBWNGYQ5OBTWRT6ZG7NKIQYPQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.984091582 (44h2m43.455302321s) [noise=true , address=185.167.204.205:4026 , piece_id=4QUQNQEML7X3MWDT3BW2V6HVKMEB34HY5ZOCGJTD4LDH7TOABC4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:06.997908141 (44h2m43.46911888s) [noise=true , address=185.167.204.205:4027 , piece_id=XE55BFKL5EEYCUI6F3CG2OMHWXTVPADE6N2BIEFODT77MVXUPTKA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:07.704382372 (44h2m44.175593111s) [noise=true , address=185.167.204.206:4052 , piece_id=JV4GC5Y3HXU44FVMMZZDHMN5LD6AK4SO3236KBKKZEZJQ3VOMHLQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:08.306751277 (44h2m44.777962016s) [noise=true , address=185.167.204.205:4032 , piece_id=IL72GNJOSYSISBLOZZXISW6BNHXNSUWMBTKBBWCRI4EWG5WSHTZA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:09.728807001 (44h2m46.20001773s) [noise=true , address=185.167.204.205:4001 , piece_id=M6RNATECMXPRLAIBWCYRLCOCEBZHGTZAM2PFPEUGGB2LXT3TKW4Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:10.200462412 (44h2m46.671673151s) [noise=true , address=185.167.204.206:4043 , piece_id=ENHMBBAPVWOYLWG6S2AB75MWWY65ZMWVFGT6LQR6OOH6AMBAANGA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:11.218612754 (44h2m47.689823493s) [noise=true , address=185.167.204.205:4030 , piece_id=JBKFARJUDMQFJIUND5IQTHLCNHQVYHR4P5XOQK24RCDCERC5X72A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:22.049936661 (44h2m58.52114739s) [noise=true , address=185.167.204.205:4014 , piece_id=SZPBSMVDNUZ5IT4O7RFMEHY5EY64L2XO545LU6IRO6HFDSUYINXQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:23.835508896 (44h3m0.306719625s) [noise=true , address=185.167.204.206:4056 , piece_id=GEVQRJW4TE7XTCGJX5HVUSBIKML5ESGM5NWVVDU7ELANJRRT4W5Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:26.013124099 (44h3m2.484334839s) [noise=true , address=185.167.204.206:4041 , piece_id=TOGP35PMCLIUVYB4J6N64ARHRMHKVKQE2IONNQEW32KCPNQYPL2A, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:27.982649379 (44h3m4.453860109s) [noise=true , address=185.167.204.205:4021 , piece_id=D6JKU2MXC3JPLXAGMZCG4BS7HQ3FCQ4XXBSNEAHMVYKGG66SSTQQ, seg_pos={0 0}, upload=38726]: Done uploading piece. err: <nil> Dec 5 12:58:31.996355435 (44h3m8.467566194s) [noise=true , address=185.167.204.205:4023 , piece_id=ILTPO5YLTESQGUBGOJXI4VSRW4VTWW5CYYNHWVVYWBOM6ULD2UBA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; close tcp 188.166.225.170:34390->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996542821 (44h3m8.46775356s) [noise=true , address=185.167.204.205:4035 , piece_id=MGAKVZ4LYIJ27QPPLUJK5CHPALW2P2FCQF2SHHP6SB7NKD2PUS2Q, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996709960 (44h3m8.467920699s) [noise=true , address=185.167.204.205:4009 , piece_id=HVAWJST2LC3GRHBQKGMDBQNUJLZY6MWNXZWNKFT5BBMYDK7TZEWA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Dec 5 12:58:31.996823235 (44h3m8.468033974s) [noise=true , address=185.167.204.205:4002 , piece_id=4CRJ6ZV5WOJVT7WCEGZHU5HQ56VXZXJ4RB4IBLTRC6CPUQTFOLRA, seg_pos={0 0}, upload=38726]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 5 12:58:31.996866238 (44h3m8.468076977s) [seg_pos={0 0}, upload=38726]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Dec 5 12:58:32.172198764 (44h3m8.643409493s) [upload=38726]: Done uploading segments... Dec 5 12:58:32.172234372 (44h3m8.643445101s) [upload=38726]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.862980077s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 26 out of 60 is failed (threshold=6) [..X..............XX.....XXXX.X....XX...XXX.XX..X.XXX.XXXXXXX] duration: 5.00221046s trace: https://jaeger.dev.storj.io/trace/587c68989c34b16d FAIL (2025-12-05 13:11:52 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00223566s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)