Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 20.579622539s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:46:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 20.579651585s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.707590464s trace: https://jaeger.dev.storj.io/trace/3c006c90b6c964ef FAIL (2025-12-07 13:46:26 UTC) orbiter warning: context deadline exceeded Duration: 6.707621222s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [......X..X..X.....X.X......X.X.X.X............X.............] duration: 5.001520283s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:46:16 UTC) orbiter warning: context deadline exceeded Duration: 5.0015614s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.31478651s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:45:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 5.314818942s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 7.994974447s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:45:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 7.995002469s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [.......X..X..X.....X.X......X.X.X.X............X............] duration: 3.685597777s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:45:53 UTC) orbiter warning: context deadline exceeded Duration: 3.685624267s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 11.181795122s trace: https://jaeger.dev.storj.io/trace/3c006c90b6c964ef FAIL (2025-12-07 13:45:37 UTC) orbiter warning: context deadline exceeded Duration: 11.181823366s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.718843614s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:45:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 5.718874883s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.266458235s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:44:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.266489013s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [........X..X..X.....X.X......X.X.X.X............X...........] duration: 4.636005954s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:44:45 UTC) orbiter warning: context deadline exceeded Duration: 4.636027214s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 4.668946769s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:44:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 4.668976867s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.137798281s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:44:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.137831754s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 9.772781627s trace: https://jaeger.dev.storj.io/trace/3c006c90b6c964ef FAIL (2025-12-07 13:44:24 UTC) orbiter warning: context deadline exceeded Duration: 9.772810693s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.577301559s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:44:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 5.577350273s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001707093s trace: https://jaeger.dev.storj.io/trace/3c006c90b6c964ef FAIL (2025-12-07 13:44:13 UTC) orbiter warning: context deadline exceeded Duration: 30.001733645s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.072782189s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:44:00 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.072806285s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [.........X..X..X.....X.X......X.X.X.X............X..........] duration: 5.00126904s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:43:56 UTC) orbiter warning: context deadline exceeded Duration: 5.001371665s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.189208584s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:43:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 6.189240906s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [..........X..X..X.....X.X......X.X.X.X............X.........] duration: 5.001115697s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:43:11 UTC) orbiter warning: context deadline exceeded Duration: 5.00114367s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.950786585s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:42:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.950818145s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.412068245s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:42:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 5.412088475s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [...........X..X..X.....X.X......X.X.X.X............X........] duration: 5.000959944s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:42:52 UTC) orbiter warning: context deadline exceeded Duration: 5.000978358s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.845602739s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:42:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 5.8456291s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.180827084s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:42:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.180875596s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.258815018s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:41:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.258835377s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 4.680741112s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:41:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 4.680765348s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [............X..X..X.....X.X......X.X.X.X............X.......] duration: 5.001470805s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:41:42 UTC) orbiter warning: context deadline exceeded Duration: 5.001493959s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.591239972s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:41:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 6.591266272s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [.............X..X..X.....X.X......X.X.X.X............X......] duration: 5.001402587s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:41:10 UTC) orbiter warning: context deadline exceeded Duration: 5.001426975s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.082433247s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:40:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.082460218s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [..............X..X..X.....X.X......X.X.X.X............X.....] duration: 4.661012092s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:40:36 UTC) orbiter warning: context deadline exceeded Duration: 4.661044946s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.793686218s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:40:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 5.79371381s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.388532455s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:40:06 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.388566088s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [...............X..X..X.....X.X......X.X.X.X............X....] duration: 4.915616908s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:40:03 UTC) orbiter warning: context deadline exceeded Duration: 4.91564891s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 4.768661411s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:39:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 4.768692s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.141409426s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:39:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.141434093s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.22709039s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:39:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 5.227114617s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [................X..X..X.....X.X......X.X.X.X............X...] duration: 3.379679423s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:39:24 UTC) orbiter warning: context deadline exceeded Duration: 3.379709409s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [.................X..X..X.....X.X......X.X.X.X............X..] duration: 4.67870747s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:39:07 UTC) orbiter warning: context deadline exceeded Duration: 4.67873844s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.123097504s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:38:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.12312147s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 4.702708041s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:38:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 4.702884496s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [..................X..X..X.....X.X......X.X.X.X............X.] duration: 5.001492516s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:38:13 UTC) orbiter warning: context deadline exceeded Duration: 5.001519236s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.285259362s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:38:00 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.285290012s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.267398273s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:37:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 5.267426759s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 10 out of 60 is failed (threshold=6) [...................X..X..X.....X.X......X.X.X.X............X] duration: 5.001011591s trace: https://jaeger.dev.storj.io/trace/4d25551aedbc7755 FAIL (2025-12-07 13:37:22 UTC) orbiter warning: context deadline exceeded Duration: 5.001034957s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.126623737s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:37:09 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.126673802s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.851514198s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:36:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 5.851537262s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 9 out of 60 is failed (threshold=6) [....................X..X..X.....X.X......X.X.X.X............] duration: 3.478917512s trace: https://jaeger.dev.storj.io/trace/1872103eb4d60fbe FAIL (2025-12-07 13:36:53 UTC) orbiter warning: context deadline exceeded Duration: 3.478937631s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.439157839s trace: https://jaeger.dev.storj.io/trace/283e9fdf7d669e1 FAIL (2025-12-07 13:36:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.439198587s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 4.94763865s trace: https://jaeger.dev.storj.io/trace/69fea742bb5563f FAIL (2025-12-07 13:36:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3:34:09.075818079 (46h5m8.946901124s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076281922 (46h5m8.947364967s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.076553229 (46h5m8.947636274s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077163871 (46h5m8.948246906s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077309289 (46h5m8.948392324s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.077962361 (46h5m8.949045396s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078248908 (46h5m8.949331943s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.078883085 (46h5m8.94996613s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.079129194 (46h5m8.950212229s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.080619522 (46h5m8.951702557s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.084989012 (46h5m8.956072057s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Uploading piece... Dec 7 13:34:09.933941987 (46h5m9.805025032s) [upload=40483]: Next returned nil segment Dec 7 13:34:09.933960352 (46h5m9.805043387s) [upload=40483]: Waiting for error group managing segments... Dec 7 13:34:10.314416476 (46h5m10.185499511s) [noise=true , address=185.167.204.205:4023 , piece_id=RE5LLEWNXNH2T2EH26WBJFOL3F263AZSUGAJRSSBTGL6E5YPGK4A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.315930819 (46h5m10.187013854s) [noise=true , address=185.167.204.205:4012 , piece_id=TSLAO6GYBEW6H6VU3LHEMRBXN4AYPIIJX4RQRICU4TI4SV4EIQMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.316192217 (46h5m10.187275253s) [noise=true , address=185.167.204.206:4038 , piece_id=UJZSNFHPAVU36BQMHTTHA2BLAJFXV4TBL2NVM6PGXKVOVU76HWGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318239817 (46h5m10.189322852s) [noise=true , address=185.167.204.205:4022 , piece_id=TKAY5YOMCTGY2OXWTNVKKJP2Z4MDRT5KP4IVBJ2XZNVKHF557UOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318328675 (46h5m10.18941171s) [noise=true , address=185.167.204.205:4015 , piece_id=LSHEVKWYPC7U4JJ7E5HXB6GMXYZEDOGYDQN52I3DKMMWCIWWQ5VQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.318862753 (46h5m10.189945788s) [noise=true , address=185.167.204.205:4008 , piece_id=Z6DEW7KS5TILMX67WMRZGTGSKBDUMM66STKCHVEUZPOBG4KJUVOQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319210205 (46h5m10.19029324s) [noise=true , address=185.167.204.205:4017 , piece_id=GIPSPNWF2XZ6KR4TLL2CB5HEEHFXZ2F73XZWJOCVNA6HH4DSUJVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319463276 (46h5m10.190546321s) [noise=true , address=185.167.204.206:4041 , piece_id=7VRTNG74T6HRJTU2NSZNDRWWDXATW5FB6T5NSIKD7WIONTTSBIDQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.319745574 (46h5m10.190828619s) [noise=true , address=185.167.204.206:4059 , piece_id=C7WC2GK7IYAEL4KDX2VWESKEK2DTAM4B6EDGYZK6VVDERRG4QOGQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321012415 (46h5m10.192095451s) [noise=true , address=185.167.204.206:4050 , piece_id=66ECRZE36STYTDMGHTBOM3DTDVC4S5NM5I4ZC37R6HHCBANGTA5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.321147473 (46h5m10.192230518s) [noise=true , address=185.167.204.205:4011 , piece_id=5ZBASC47XE6O4GTLY3ZJVG4SHXDFTYWZIAMBWS6HGFENWRUOO6VA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322113953 (46h5m10.193196998s) [noise=true , address=185.167.204.206:4045 , piece_id=SYDSXP2FNLMDCWX35PFKVE53FPRNKFI5N2TJ23UZ2JR3SNELFEDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.322676755 (46h5m10.19375979s) [noise=true , address=185.167.204.205:4001 , piece_id=2GOKRUQBU7ZFX3VU5EBXPFXA65UPZQ2AN74AFLLU7DEY23P6RBUQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.323659166 (46h5m10.194742211s) [noise=true , address=185.167.204.205:4013 , piece_id=VDQZXTLTFJMTOEUKIKCZKFUBAPYYDD75TIP6GW7FMRPAXEU3KHVQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.324338770 (46h5m10.195421815s) [noise=true , address=185.167.204.206:4053 , piece_id=LQLGWN4TAQPTT6UACJTGXDZJFWMILHJSGLDAS7Z22EJRQ2OOL42A, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.326313070 (46h5m10.197396115s) [noise=true , address=185.167.204.205:4024 , piece_id=UCLOA2PXIWDWQZCNCQBJ7AH3LXSAR7OC6JLCNFSTO3PH7GPWM3HA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.327662930 (46h5m10.198745965s) [noise=true , address=185.167.204.206:4065 , piece_id=FPAKAHS4K4NJSPSNJVSJT3PWAJFYN4R3VEP2GXKWBMYP3GPUQXOA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.330282949 (46h5m10.201365984s) [noise=true , address=185.167.204.205:4018 , piece_id=D3YPHFX6HLRAGIPIONQBRRYKBJHCEVH23YZCKYQ43TJBOH6E2DNA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.871620444 (46h5m10.742703489s) [noise=true , address=81.171.14.70:4033 , piece_id=GLQZHQKYGPECLFZ7H2ZA3Z2AAF4YEZGYTYPZV4CZKAKDJ3NEYFDA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.902859340 (46h5m10.773942375s) [noise=true , address=81.171.14.70:4026 , piece_id=LRLDO6DWH3LBOQUUAZKBY63SP4XUHA7FBGSCFD4O3M3BCGFVCBMA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.905110235 (46h5m10.77619328s) [noise=true , address=81.171.14.70:4045 , piece_id=UYGQ3JTQM4NCM4265W2KBWSMNSLGO64VUC3SGLEY7OSCNAPDLBUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.911885487 (46h5m10.782968532s) [noise=true , address=81.171.14.70:4036 , piece_id=UZ7VD6Y6JIHOCD3WKJB3QL55HNXBP664YDWW7JCTZT5JQMQNS2YQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.926756744 (46h5m10.797839779s) [noise=true , address=81.171.14.70:4025 , piece_id=C4DVW7DJ7QK5FI6QWO5RAVJSBBVJZPNW4VFTU6ALTANUAJALJRUA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.964743338 (46h5m10.835826373s) [noise=true , address=81.171.14.70:4037 , piece_id=UTU4VVFEYSIHYUFZIL5HEMGCLHGMUSX3XCQS67TM42GAYGEYUL5Q, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:10.967618603 (46h5m10.838701648s) [noise=true , address=81.171.14.70:4027 , piece_id=SO5FRDVUPT62NDFSJNPAZVU7GS5TBBWB77JFFZEAVQX5WBDHSBVA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496244042 (46h5m11.367327087s) [noise=true , address=89.149.201.147:4018 , piece_id=WYMIGLMZNSYSAVCGK5RYEHQ6OJ65PZZKWXPA4TFZWH5LE6XUIMYA, seg_pos={0 0}, upload=40483]: Done uploading piece. err: <nil> Dec 7 13:34:11.496291964 (46h5m11.367375029s) [seg_pos={0 0}, upload=40483]: Segment reached optimal threshold of 26 pieces. Dec 7 13:34:11.496545716 (46h5m11.367628782s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496555585 (46h5m11.36763865s) [noise=true , address=89.149.201.147:4022 , piece_id=6H4DOW2NZEBUX4LZ5AW6XUXKAZAJFN2RHW3U2LU7UPRNQYRPS7JQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496573189 (46h5m11.367656234s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 7 13:34:11.496581615 (46h5m11.36766466s) [noise=true , address=89.149.201.147:4001 , piece_id=5B5VYHQ7RROR5VQDBI4CVK6FPGGGTYIWT6AD5ZN3D2LB5B4H5FTQ, seg_pos={0 0}, upload=40483]: Long tail cancellation due to optimal threshold Dec 7 13:34:11.496602705 (46h5m11.36768575s) [seg_pos={0 0}, upload=40483]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 7 13:34:11.496706563 (46h5m11.367789618s) [upload=40483]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 7 13:34:11.496714889 (46h5m11.367797934s) [upload=40483]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 7 13:34:11.752435512 (46h5m11.623518557s) [upload=40483]: Done uploading segments... Dec 7 13:34:11.752456522 (46h5m11.623539567s) [upload=40483]: Upload finished. err: <nil> Duration: 4.947667666s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)