Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 353524 reports (Page 207 of 7071)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration: 
45.375912025s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:17:46 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 45.375931982s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [............X...............................................]
duration: 
6.78784613s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:17:37 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 6.787876669s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................................X............]
duration: 
57.20848648s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:17:00 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 57.208520436s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
21 out of 60 is failed (threshold=6) [..X..X.....X.....X....XXX...XXXX.........X.X.....X..XXXXXX.X]
duration: 
5.001170759s
trace: 
https://jaeger.dev.storj.io/trace/14547861cf082dcb
FAIL (2025-12-30 07:16:58 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.001194134s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration: 
8.114245821s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:16:35 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 8.11427657s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
21 out of 60 is failed (threshold=6) [X..X..X.....X.....X....XXX...XXXX.........X.X.....X..XXXXXX.]
duration: 
3.636648815s
trace: 
https://jaeger.dev.storj.io/trace/564842a3d2df59eb
FAIL (2025-12-30 07:16:27 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.636676008s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
17 out of 60 is failed (threshold=3) [...X.X.....X....XX...X.....X....XXX..X.....X...X..X.XX..X...]
duration: 
6.114914774s
trace: 
https://jaeger.dev.storj.io/trace/1f6a8c2d9df24810
FAIL (2025-12-30 07:16:25 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ng segments...
Dec 30 07:13:38.042043341 (591h44m37.913126387s) [upload=518755]: Got next segment. Inline: false
Dec 30 07:13:38.042101232 (591h44m37.913184277s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 07:13:38.042153631 (591h44m37.913236696s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:13:38.286247895 (591h44m38.15733094s) [seg_pos={0 0}, upload=518755]: Begin upload segment...
Dec 30 07:13:38.286375839 (591h44m38.157458874s) [seg_pos={0 0}, upload=518755]: Done begin upload segment.
Dec 30 07:13:38.286388603 (591h44m38.157471638s) [noise=true , address=45.91.116.12:4225    , piece_id=6H2HRMX56ARF46BLBQHRPYTRN4FCRLJ6QTHMKLFLWWGYSYDEHMOQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.286417037 (591h44m38.157500092s) [noise=true , address=145.79.227.19:4079   , piece_id=CYDDXHGMBJPITSFQH3ENTAEDW7N34RPP25Y7QIUNAO4CK6EIUKSA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.287076844 (591h44m38.158159899s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.287623854 (591h44m38.158706889s) [noise=true , address=145.79.227.15:4874   , piece_id=G33I6EA2ZZQ6X7LNN3T7CZ6IPVHJT2TOXKW5QI3NUHBDAWYBBA2Q, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288021873 (591h44m38.159104918s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288385635 (591h44m38.15946868s) [noise=true , address=145.79.227.2:4114    , piece_id=IWZUCVVZTVJRUF3474WSCVTVGI7CL3M53RK6M4SFQ46MGY7KYPPQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288772432 (591h44m38.159855467s) [noise=true , address=77.90.31.19:4842     , piece_id=7QZKDL4TABS3ASEBD72F3ZROTJFA3NAJ5IBNRWO7KUZUYLDFSRCQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.289115886 (591h44m38.160198921s) [noise=true , address=145.79.227.21:4475   , piece_id=EM2YILJ367XAHJDL7KNWKXVHLMDATTWMG723AUE6OYXQXKRP6Q7A, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.289572184 (591h44m38.160655219s) [noise=true , address=145.79.227.39:4013   , piece_id=N2W76DWGVXU3M57CIYSUBZ2J6QEJY25LJAMZ6DYH6GHSHJPH53LQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290041459 (591h44m38.161124524s) [noise=true , address=145.79.227.38:4978   , piece_id=QQ4MJMFUYH5K7GGEOOTTE7RSID53PEX4SVYTFX7B3CKGJZPMSGVA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290261177 (591h44m38.161344222s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290927936 (591h44m38.162010981s) [noise=true , address=77.90.31.17:4773     , piece_id=WLBLTVGH7CD2CDUQANYK2LWADBXOBOHGZBPSJALVHWM5MRFKOUNQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.291617379 (591h44m38.162700424s) [noise=true , address=145.79.227.36:4517   , piece_id=WPAHWZEI3V7WWDMBVIF6R7HF4RDRFVV3N2SCHHAZ67YAYT7ZETXA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.294013602 (591h44m38.165096647s) [noise=true , address=45.91.116.11:4119    , piece_id=RFQEYFWRI542T5TXDE6VJAGEVDF77C54HBHM3RU7YX7EAYTCWQAQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.295924711 (591h44m38.167007756s) [noise=true , address=77.90.31.15:4700     , piece_id=A3MW2KZHYFCKTC5EYUOOFM66VLMYGFHVMH2Y6JOT5EXEFXIWTWEQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.297637683 (591h44m38.168720728s) [noise=true , address=145.79.227.22:4510   , piece_id=3IDGW2YLCW2TTXN5ONSCPQQP4LHUSDKNJ73BDLKIGHPJJDJVDKDA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:39.995993146 (591h44m39.867076191s) [upload=518755]: Next returned nil segment
Dec 30 07:13:39.996006982 (591h44m39.867090017s) [upload=518755]: Waiting for error group managing segments...
Dec 30 07:13:40.274040140 (591h44m40.145123175s) [noise=true , address=145.79.227.39:4013   , piece_id=N2W76DWGVXU3M57CIYSUBZ2J6QEJY25LJAMZ6DYH6GHSHJPH53LQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.291621177 (591h44m40.162704232s) [noise=true , address=145.79.227.22:4510   , piece_id=3IDGW2YLCW2TTXN5ONSCPQQP4LHUSDKNJ73BDLKIGHPJJDJVDKDA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.300279885 (591h44m40.17136292s) [noise=true , address=145.79.227.2:4114    , piece_id=IWZUCVVZTVJRUF3474WSCVTVGI7CL3M53RK6M4SFQ46MGY7KYPPQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.332460582 (591h44m40.203543617s) [noise=true , address=145.79.227.36:4517   , piece_id=WPAHWZEI3V7WWDMBVIF6R7HF4RDRFVV3N2SCHHAZ67YAYT7ZETXA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.356896341 (591h44m40.227979376s) [noise=true , address=145.79.227.21:4475   , piece_id=EM2YILJ367XAHJDL7KNWKXVHLMDATTWMG723AUE6OYXQXKRP6Q7A, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.362441972 (591h44m40.233525017s) [noise=true , address=145.79.227.38:4978   , piece_id=QQ4MJMFUYH5K7GGEOOTTE7RSID53PEX4SVYTFX7B3CKGJZPMSGVA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.367341971 (591h44m40.238425016s) [noise=true , address=145.79.227.15:4874   , piece_id=G33I6EA2ZZQ6X7LNN3T7CZ6IPVHJT2TOXKW5QI3NUHBDAWYBBA2Q, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.446738635 (591h44m40.31782167s) [noise=true , address=145.79.227.19:4079   , piece_id=CYDDXHGMBJPITSFQH3ENTAEDW7N34RPP25Y7QIUNAO4CK6EIUKSA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.451071757 (591h44m40.322154802s) [noise=true , address=77.90.31.15:4700     , piece_id=A3MW2KZHYFCKTC5EYUOOFM66VLMYGFHVMH2Y6JOT5EXEFXIWTWEQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.537648352 (591h44m40.408731397s) [noise=true , address=77.90.31.17:4773     , piece_id=WLBLTVGH7CD2CDUQANYK2LWADBXOBOHGZBPSJALVHWM5MRFKOUNQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.558704647 (591h44m40.429787692s) [noise=true , address=77.90.31.19:4842     , piece_id=7QZKDL4TABS3ASEBD72F3ZROTJFA3NAJ5IBNRWO7KUZUYLDFSRCQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.620320323 (591h44m40.491403359s) [noise=true , address=45.91.116.12:4225    , piece_id=6H2HRMX56ARF46BLBQHRPYTRN4FCRLJ6QTHMKLFLWWGYSYDEHMOQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.773004187 (591h44m40.644087222s) [noise=true , address=45.91.116.11:4119    , piece_id=RFQEYFWRI542T5TXDE6VJAGEVDF77C54HBHM3RU7YX7EAYTCWQAQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.773033281 (591h44m40.644116316s) [seg_pos={0 0}, upload=518755]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:13:40.773304829 (591h44m40.644387924s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: expected piece hash; context canceled; EOF
Dec 30 07:13:40.773322072 (591h44m40.644405117s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773394099 (591h44m40.644477144s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection
Dec 30 07:13:40.773409117 (591h44m40.644492152s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773559574 (591h44m40.644642619s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection
Dec 30 07:13:40.773569353 (591h44m40.644652398s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773599039 (591h44m40.644682084s) [seg_pos={0 0}, upload=518755]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:13:40.773736952 (591h44m40.644819997s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:13:40.773745849 (591h44m40.644828894s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:13:41.055474715 (591h44m40.92655776s) [upload=518755]: Done uploading segments...
Dec 30 07:13:41.055497147 (591h44m40.926580182s) [upload=518755]: Upload finished. err: <nil>
Duration: 6.114935123s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
21 out of 60 is failed (threshold=6) [.X..X..X.....X.....X....XXX...XXXX.........X.X.....X..XXXXXX]
duration: 
5.001045421s
trace: 
https://jaeger.dev.storj.io/trace/564842a3d2df59eb
FAIL (2025-12-30 07:15:35 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.001066663s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration: 
6.764148966s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:15:34 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 6.764180205s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [................................................X...........]
duration: 
15.072141356s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:15:28 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 15.072171104s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
17 out of 60 is failed (threshold=3) [....X.X.....X....XX...X.....X....XXX..X.....X...X..X.XX..X..]
duration: 
5.775154469s
trace: 
https://jaeger.dev.storj.io/trace/1f6a8c2d9df24810
FAIL (2025-12-30 07:15:26 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ng segments...
Dec 30 07:13:38.042043341 (591h44m37.913126387s) [upload=518755]: Got next segment. Inline: false
Dec 30 07:13:38.042101232 (591h44m37.913184277s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 07:13:38.042153631 (591h44m37.913236696s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:13:38.286247895 (591h44m38.15733094s) [seg_pos={0 0}, upload=518755]: Begin upload segment...
Dec 30 07:13:38.286375839 (591h44m38.157458874s) [seg_pos={0 0}, upload=518755]: Done begin upload segment.
Dec 30 07:13:38.286388603 (591h44m38.157471638s) [noise=true , address=45.91.116.12:4225    , piece_id=6H2HRMX56ARF46BLBQHRPYTRN4FCRLJ6QTHMKLFLWWGYSYDEHMOQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.286417037 (591h44m38.157500092s) [noise=true , address=145.79.227.19:4079   , piece_id=CYDDXHGMBJPITSFQH3ENTAEDW7N34RPP25Y7QIUNAO4CK6EIUKSA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.287076844 (591h44m38.158159899s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.287623854 (591h44m38.158706889s) [noise=true , address=145.79.227.15:4874   , piece_id=G33I6EA2ZZQ6X7LNN3T7CZ6IPVHJT2TOXKW5QI3NUHBDAWYBBA2Q, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288021873 (591h44m38.159104918s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288385635 (591h44m38.15946868s) [noise=true , address=145.79.227.2:4114    , piece_id=IWZUCVVZTVJRUF3474WSCVTVGI7CL3M53RK6M4SFQ46MGY7KYPPQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288772432 (591h44m38.159855467s) [noise=true , address=77.90.31.19:4842     , piece_id=7QZKDL4TABS3ASEBD72F3ZROTJFA3NAJ5IBNRWO7KUZUYLDFSRCQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.289115886 (591h44m38.160198921s) [noise=true , address=145.79.227.21:4475   , piece_id=EM2YILJ367XAHJDL7KNWKXVHLMDATTWMG723AUE6OYXQXKRP6Q7A, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.289572184 (591h44m38.160655219s) [noise=true , address=145.79.227.39:4013   , piece_id=N2W76DWGVXU3M57CIYSUBZ2J6QEJY25LJAMZ6DYH6GHSHJPH53LQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290041459 (591h44m38.161124524s) [noise=true , address=145.79.227.38:4978   , piece_id=QQ4MJMFUYH5K7GGEOOTTE7RSID53PEX4SVYTFX7B3CKGJZPMSGVA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290261177 (591h44m38.161344222s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290927936 (591h44m38.162010981s) [noise=true , address=77.90.31.17:4773     , piece_id=WLBLTVGH7CD2CDUQANYK2LWADBXOBOHGZBPSJALVHWM5MRFKOUNQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.291617379 (591h44m38.162700424s) [noise=true , address=145.79.227.36:4517   , piece_id=WPAHWZEI3V7WWDMBVIF6R7HF4RDRFVV3N2SCHHAZ67YAYT7ZETXA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.294013602 (591h44m38.165096647s) [noise=true , address=45.91.116.11:4119    , piece_id=RFQEYFWRI542T5TXDE6VJAGEVDF77C54HBHM3RU7YX7EAYTCWQAQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.295924711 (591h44m38.167007756s) [noise=true , address=77.90.31.15:4700     , piece_id=A3MW2KZHYFCKTC5EYUOOFM66VLMYGFHVMH2Y6JOT5EXEFXIWTWEQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.297637683 (591h44m38.168720728s) [noise=true , address=145.79.227.22:4510   , piece_id=3IDGW2YLCW2TTXN5ONSCPQQP4LHUSDKNJ73BDLKIGHPJJDJVDKDA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:39.995993146 (591h44m39.867076191s) [upload=518755]: Next returned nil segment
Dec 30 07:13:39.996006982 (591h44m39.867090017s) [upload=518755]: Waiting for error group managing segments...
Dec 30 07:13:40.274040140 (591h44m40.145123175s) [noise=true , address=145.79.227.39:4013   , piece_id=N2W76DWGVXU3M57CIYSUBZ2J6QEJY25LJAMZ6DYH6GHSHJPH53LQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.291621177 (591h44m40.162704232s) [noise=true , address=145.79.227.22:4510   , piece_id=3IDGW2YLCW2TTXN5ONSCPQQP4LHUSDKNJ73BDLKIGHPJJDJVDKDA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.300279885 (591h44m40.17136292s) [noise=true , address=145.79.227.2:4114    , piece_id=IWZUCVVZTVJRUF3474WSCVTVGI7CL3M53RK6M4SFQ46MGY7KYPPQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.332460582 (591h44m40.203543617s) [noise=true , address=145.79.227.36:4517   , piece_id=WPAHWZEI3V7WWDMBVIF6R7HF4RDRFVV3N2SCHHAZ67YAYT7ZETXA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.356896341 (591h44m40.227979376s) [noise=true , address=145.79.227.21:4475   , piece_id=EM2YILJ367XAHJDL7KNWKXVHLMDATTWMG723AUE6OYXQXKRP6Q7A, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.362441972 (591h44m40.233525017s) [noise=true , address=145.79.227.38:4978   , piece_id=QQ4MJMFUYH5K7GGEOOTTE7RSID53PEX4SVYTFX7B3CKGJZPMSGVA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.367341971 (591h44m40.238425016s) [noise=true , address=145.79.227.15:4874   , piece_id=G33I6EA2ZZQ6X7LNN3T7CZ6IPVHJT2TOXKW5QI3NUHBDAWYBBA2Q, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.446738635 (591h44m40.31782167s) [noise=true , address=145.79.227.19:4079   , piece_id=CYDDXHGMBJPITSFQH3ENTAEDW7N34RPP25Y7QIUNAO4CK6EIUKSA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.451071757 (591h44m40.322154802s) [noise=true , address=77.90.31.15:4700     , piece_id=A3MW2KZHYFCKTC5EYUOOFM66VLMYGFHVMH2Y6JOT5EXEFXIWTWEQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.537648352 (591h44m40.408731397s) [noise=true , address=77.90.31.17:4773     , piece_id=WLBLTVGH7CD2CDUQANYK2LWADBXOBOHGZBPSJALVHWM5MRFKOUNQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.558704647 (591h44m40.429787692s) [noise=true , address=77.90.31.19:4842     , piece_id=7QZKDL4TABS3ASEBD72F3ZROTJFA3NAJ5IBNRWO7KUZUYLDFSRCQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.620320323 (591h44m40.491403359s) [noise=true , address=45.91.116.12:4225    , piece_id=6H2HRMX56ARF46BLBQHRPYTRN4FCRLJ6QTHMKLFLWWGYSYDEHMOQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.773004187 (591h44m40.644087222s) [noise=true , address=45.91.116.11:4119    , piece_id=RFQEYFWRI542T5TXDE6VJAGEVDF77C54HBHM3RU7YX7EAYTCWQAQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.773033281 (591h44m40.644116316s) [seg_pos={0 0}, upload=518755]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:13:40.773304829 (591h44m40.644387924s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: expected piece hash; context canceled; EOF
Dec 30 07:13:40.773322072 (591h44m40.644405117s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773394099 (591h44m40.644477144s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection
Dec 30 07:13:40.773409117 (591h44m40.644492152s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773559574 (591h44m40.644642619s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection
Dec 30 07:13:40.773569353 (591h44m40.644652398s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773599039 (591h44m40.644682084s) [seg_pos={0 0}, upload=518755]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:13:40.773736952 (591h44m40.644819997s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:13:40.773745849 (591h44m40.644828894s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:13:41.055474715 (591h44m40.92655776s) [upload=518755]: Done uploading segments...
Dec 30 07:13:41.055497147 (591h44m40.926580182s) [upload=518755]: Upload finished. err: <nil>
Duration: 5.77517565s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
20 out of 60 is failed (threshold=6) [..X..X..X.....X.....X....XXX...XXXX.........X.X.....X..XXXXX]
duration: 
5.00155863s
trace: 
https://jaeger.dev.storj.io/trace/52cc4937e8f87731
FAIL (2025-12-30 07:15:09 UTC) 
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001584618s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
17 out of 60 is failed (threshold=3) [.....X.X.....X....XX...X.....X....XXX..X.....X...X..X.XX..X.]
duration: 
6.031110557s
trace: 
https://jaeger.dev.storj.io/trace/1f6a8c2d9df24810
FAIL (2025-12-30 07:14:50 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ng segments...
Dec 30 07:13:38.042043341 (591h44m37.913126387s) [upload=518755]: Got next segment. Inline: false
Dec 30 07:13:38.042101232 (591h44m37.913184277s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 07:13:38.042153631 (591h44m37.913236696s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:13:38.286247895 (591h44m38.15733094s) [seg_pos={0 0}, upload=518755]: Begin upload segment...
Dec 30 07:13:38.286375839 (591h44m38.157458874s) [seg_pos={0 0}, upload=518755]: Done begin upload segment.
Dec 30 07:13:38.286388603 (591h44m38.157471638s) [noise=true , address=45.91.116.12:4225    , piece_id=6H2HRMX56ARF46BLBQHRPYTRN4FCRLJ6QTHMKLFLWWGYSYDEHMOQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.286417037 (591h44m38.157500092s) [noise=true , address=145.79.227.19:4079   , piece_id=CYDDXHGMBJPITSFQH3ENTAEDW7N34RPP25Y7QIUNAO4CK6EIUKSA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.287076844 (591h44m38.158159899s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.287623854 (591h44m38.158706889s) [noise=true , address=145.79.227.15:4874   , piece_id=G33I6EA2ZZQ6X7LNN3T7CZ6IPVHJT2TOXKW5QI3NUHBDAWYBBA2Q, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288021873 (591h44m38.159104918s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288385635 (591h44m38.15946868s) [noise=true , address=145.79.227.2:4114    , piece_id=IWZUCVVZTVJRUF3474WSCVTVGI7CL3M53RK6M4SFQ46MGY7KYPPQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288772432 (591h44m38.159855467s) [noise=true , address=77.90.31.19:4842     , piece_id=7QZKDL4TABS3ASEBD72F3ZROTJFA3NAJ5IBNRWO7KUZUYLDFSRCQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.289115886 (591h44m38.160198921s) [noise=true , address=145.79.227.21:4475   , piece_id=EM2YILJ367XAHJDL7KNWKXVHLMDATTWMG723AUE6OYXQXKRP6Q7A, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.289572184 (591h44m38.160655219s) [noise=true , address=145.79.227.39:4013   , piece_id=N2W76DWGVXU3M57CIYSUBZ2J6QEJY25LJAMZ6DYH6GHSHJPH53LQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290041459 (591h44m38.161124524s) [noise=true , address=145.79.227.38:4978   , piece_id=QQ4MJMFUYH5K7GGEOOTTE7RSID53PEX4SVYTFX7B3CKGJZPMSGVA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290261177 (591h44m38.161344222s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290927936 (591h44m38.162010981s) [noise=true , address=77.90.31.17:4773     , piece_id=WLBLTVGH7CD2CDUQANYK2LWADBXOBOHGZBPSJALVHWM5MRFKOUNQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.291617379 (591h44m38.162700424s) [noise=true , address=145.79.227.36:4517   , piece_id=WPAHWZEI3V7WWDMBVIF6R7HF4RDRFVV3N2SCHHAZ67YAYT7ZETXA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.294013602 (591h44m38.165096647s) [noise=true , address=45.91.116.11:4119    , piece_id=RFQEYFWRI542T5TXDE6VJAGEVDF77C54HBHM3RU7YX7EAYTCWQAQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.295924711 (591h44m38.167007756s) [noise=true , address=77.90.31.15:4700     , piece_id=A3MW2KZHYFCKTC5EYUOOFM66VLMYGFHVMH2Y6JOT5EXEFXIWTWEQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.297637683 (591h44m38.168720728s) [noise=true , address=145.79.227.22:4510   , piece_id=3IDGW2YLCW2TTXN5ONSCPQQP4LHUSDKNJ73BDLKIGHPJJDJVDKDA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:39.995993146 (591h44m39.867076191s) [upload=518755]: Next returned nil segment
Dec 30 07:13:39.996006982 (591h44m39.867090017s) [upload=518755]: Waiting for error group managing segments...
Dec 30 07:13:40.274040140 (591h44m40.145123175s) [noise=true , address=145.79.227.39:4013   , piece_id=N2W76DWGVXU3M57CIYSUBZ2J6QEJY25LJAMZ6DYH6GHSHJPH53LQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.291621177 (591h44m40.162704232s) [noise=true , address=145.79.227.22:4510   , piece_id=3IDGW2YLCW2TTXN5ONSCPQQP4LHUSDKNJ73BDLKIGHPJJDJVDKDA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.300279885 (591h44m40.17136292s) [noise=true , address=145.79.227.2:4114    , piece_id=IWZUCVVZTVJRUF3474WSCVTVGI7CL3M53RK6M4SFQ46MGY7KYPPQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.332460582 (591h44m40.203543617s) [noise=true , address=145.79.227.36:4517   , piece_id=WPAHWZEI3V7WWDMBVIF6R7HF4RDRFVV3N2SCHHAZ67YAYT7ZETXA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.356896341 (591h44m40.227979376s) [noise=true , address=145.79.227.21:4475   , piece_id=EM2YILJ367XAHJDL7KNWKXVHLMDATTWMG723AUE6OYXQXKRP6Q7A, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.362441972 (591h44m40.233525017s) [noise=true , address=145.79.227.38:4978   , piece_id=QQ4MJMFUYH5K7GGEOOTTE7RSID53PEX4SVYTFX7B3CKGJZPMSGVA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.367341971 (591h44m40.238425016s) [noise=true , address=145.79.227.15:4874   , piece_id=G33I6EA2ZZQ6X7LNN3T7CZ6IPVHJT2TOXKW5QI3NUHBDAWYBBA2Q, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.446738635 (591h44m40.31782167s) [noise=true , address=145.79.227.19:4079   , piece_id=CYDDXHGMBJPITSFQH3ENTAEDW7N34RPP25Y7QIUNAO4CK6EIUKSA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.451071757 (591h44m40.322154802s) [noise=true , address=77.90.31.15:4700     , piece_id=A3MW2KZHYFCKTC5EYUOOFM66VLMYGFHVMH2Y6JOT5EXEFXIWTWEQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.537648352 (591h44m40.408731397s) [noise=true , address=77.90.31.17:4773     , piece_id=WLBLTVGH7CD2CDUQANYK2LWADBXOBOHGZBPSJALVHWM5MRFKOUNQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.558704647 (591h44m40.429787692s) [noise=true , address=77.90.31.19:4842     , piece_id=7QZKDL4TABS3ASEBD72F3ZROTJFA3NAJ5IBNRWO7KUZUYLDFSRCQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.620320323 (591h44m40.491403359s) [noise=true , address=45.91.116.12:4225    , piece_id=6H2HRMX56ARF46BLBQHRPYTRN4FCRLJ6QTHMKLFLWWGYSYDEHMOQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.773004187 (591h44m40.644087222s) [noise=true , address=45.91.116.11:4119    , piece_id=RFQEYFWRI542T5TXDE6VJAGEVDF77C54HBHM3RU7YX7EAYTCWQAQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.773033281 (591h44m40.644116316s) [seg_pos={0 0}, upload=518755]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:13:40.773304829 (591h44m40.644387924s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: expected piece hash; context canceled; EOF
Dec 30 07:13:40.773322072 (591h44m40.644405117s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773394099 (591h44m40.644477144s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection
Dec 30 07:13:40.773409117 (591h44m40.644492152s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773559574 (591h44m40.644642619s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection
Dec 30 07:13:40.773569353 (591h44m40.644652398s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773599039 (591h44m40.644682084s) [seg_pos={0 0}, upload=518755]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:13:40.773736952 (591h44m40.644819997s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:13:40.773745849 (591h44m40.644828894s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:13:41.055474715 (591h44m40.92655776s) [upload=518755]: Done uploading segments...
Dec 30 07:13:41.055497147 (591h44m40.926580182s) [upload=518755]: Upload finished. err: <nil>
Duration: 6.031139161s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration: 
37.159665423s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:14:40 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 37.159710378s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
19 out of 60 is failed (threshold=6) [...X..X..X.....X.....X....XXX...XXXX.........X.X.....X..XXXX]
duration: 
5.001047526s
trace: 
https://jaeger.dev.storj.io/trace/161b67c67a76b4e2
FAIL (2025-12-30 07:14:39 UTC) 
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001064679s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [...............X............................................]
duration: 
6.027640879s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:14:22 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 6.027669964s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
17 out of 60 is failed (threshold=3) [......X.X.....X....XX...X.....X....XXX..X.....X...X..X.XX..X]
duration: 
30.003420911s
trace: 
https://jaeger.dev.storj.io/trace/1f6a8c2d9df24810
FAIL (2025-12-30 07:14:07 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ng segments...
Dec 30 07:13:38.042043341 (591h44m37.913126387s) [upload=518755]: Got next segment. Inline: false
Dec 30 07:13:38.042101232 (591h44m37.913184277s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 07:13:38.042153631 (591h44m37.913236696s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:13:38.286247895 (591h44m38.15733094s) [seg_pos={0 0}, upload=518755]: Begin upload segment...
Dec 30 07:13:38.286375839 (591h44m38.157458874s) [seg_pos={0 0}, upload=518755]: Done begin upload segment.
Dec 30 07:13:38.286388603 (591h44m38.157471638s) [noise=true , address=45.91.116.12:4225    , piece_id=6H2HRMX56ARF46BLBQHRPYTRN4FCRLJ6QTHMKLFLWWGYSYDEHMOQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.286417037 (591h44m38.157500092s) [noise=true , address=145.79.227.19:4079   , piece_id=CYDDXHGMBJPITSFQH3ENTAEDW7N34RPP25Y7QIUNAO4CK6EIUKSA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.287076844 (591h44m38.158159899s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.287623854 (591h44m38.158706889s) [noise=true , address=145.79.227.15:4874   , piece_id=G33I6EA2ZZQ6X7LNN3T7CZ6IPVHJT2TOXKW5QI3NUHBDAWYBBA2Q, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288021873 (591h44m38.159104918s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288385635 (591h44m38.15946868s) [noise=true , address=145.79.227.2:4114    , piece_id=IWZUCVVZTVJRUF3474WSCVTVGI7CL3M53RK6M4SFQ46MGY7KYPPQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.288772432 (591h44m38.159855467s) [noise=true , address=77.90.31.19:4842     , piece_id=7QZKDL4TABS3ASEBD72F3ZROTJFA3NAJ5IBNRWO7KUZUYLDFSRCQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.289115886 (591h44m38.160198921s) [noise=true , address=145.79.227.21:4475   , piece_id=EM2YILJ367XAHJDL7KNWKXVHLMDATTWMG723AUE6OYXQXKRP6Q7A, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.289572184 (591h44m38.160655219s) [noise=true , address=145.79.227.39:4013   , piece_id=N2W76DWGVXU3M57CIYSUBZ2J6QEJY25LJAMZ6DYH6GHSHJPH53LQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290041459 (591h44m38.161124524s) [noise=true , address=145.79.227.38:4978   , piece_id=QQ4MJMFUYH5K7GGEOOTTE7RSID53PEX4SVYTFX7B3CKGJZPMSGVA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290261177 (591h44m38.161344222s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.290927936 (591h44m38.162010981s) [noise=true , address=77.90.31.17:4773     , piece_id=WLBLTVGH7CD2CDUQANYK2LWADBXOBOHGZBPSJALVHWM5MRFKOUNQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.291617379 (591h44m38.162700424s) [noise=true , address=145.79.227.36:4517   , piece_id=WPAHWZEI3V7WWDMBVIF6R7HF4RDRFVV3N2SCHHAZ67YAYT7ZETXA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.294013602 (591h44m38.165096647s) [noise=true , address=45.91.116.11:4119    , piece_id=RFQEYFWRI542T5TXDE6VJAGEVDF77C54HBHM3RU7YX7EAYTCWQAQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.295924711 (591h44m38.167007756s) [noise=true , address=77.90.31.15:4700     , piece_id=A3MW2KZHYFCKTC5EYUOOFM66VLMYGFHVMH2Y6JOT5EXEFXIWTWEQ, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:38.297637683 (591h44m38.168720728s) [noise=true , address=145.79.227.22:4510   , piece_id=3IDGW2YLCW2TTXN5ONSCPQQP4LHUSDKNJ73BDLKIGHPJJDJVDKDA, seg_pos={0 0}, upload=518755]: Uploading piece...
Dec 30 07:13:39.995993146 (591h44m39.867076191s) [upload=518755]: Next returned nil segment
Dec 30 07:13:39.996006982 (591h44m39.867090017s) [upload=518755]: Waiting for error group managing segments...
Dec 30 07:13:40.274040140 (591h44m40.145123175s) [noise=true , address=145.79.227.39:4013   , piece_id=N2W76DWGVXU3M57CIYSUBZ2J6QEJY25LJAMZ6DYH6GHSHJPH53LQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.291621177 (591h44m40.162704232s) [noise=true , address=145.79.227.22:4510   , piece_id=3IDGW2YLCW2TTXN5ONSCPQQP4LHUSDKNJ73BDLKIGHPJJDJVDKDA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.300279885 (591h44m40.17136292s) [noise=true , address=145.79.227.2:4114    , piece_id=IWZUCVVZTVJRUF3474WSCVTVGI7CL3M53RK6M4SFQ46MGY7KYPPQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.332460582 (591h44m40.203543617s) [noise=true , address=145.79.227.36:4517   , piece_id=WPAHWZEI3V7WWDMBVIF6R7HF4RDRFVV3N2SCHHAZ67YAYT7ZETXA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.356896341 (591h44m40.227979376s) [noise=true , address=145.79.227.21:4475   , piece_id=EM2YILJ367XAHJDL7KNWKXVHLMDATTWMG723AUE6OYXQXKRP6Q7A, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.362441972 (591h44m40.233525017s) [noise=true , address=145.79.227.38:4978   , piece_id=QQ4MJMFUYH5K7GGEOOTTE7RSID53PEX4SVYTFX7B3CKGJZPMSGVA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.367341971 (591h44m40.238425016s) [noise=true , address=145.79.227.15:4874   , piece_id=G33I6EA2ZZQ6X7LNN3T7CZ6IPVHJT2TOXKW5QI3NUHBDAWYBBA2Q, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.446738635 (591h44m40.31782167s) [noise=true , address=145.79.227.19:4079   , piece_id=CYDDXHGMBJPITSFQH3ENTAEDW7N34RPP25Y7QIUNAO4CK6EIUKSA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.451071757 (591h44m40.322154802s) [noise=true , address=77.90.31.15:4700     , piece_id=A3MW2KZHYFCKTC5EYUOOFM66VLMYGFHVMH2Y6JOT5EXEFXIWTWEQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.537648352 (591h44m40.408731397s) [noise=true , address=77.90.31.17:4773     , piece_id=WLBLTVGH7CD2CDUQANYK2LWADBXOBOHGZBPSJALVHWM5MRFKOUNQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.558704647 (591h44m40.429787692s) [noise=true , address=77.90.31.19:4842     , piece_id=7QZKDL4TABS3ASEBD72F3ZROTJFA3NAJ5IBNRWO7KUZUYLDFSRCQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.620320323 (591h44m40.491403359s) [noise=true , address=45.91.116.12:4225    , piece_id=6H2HRMX56ARF46BLBQHRPYTRN4FCRLJ6QTHMKLFLWWGYSYDEHMOQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.773004187 (591h44m40.644087222s) [noise=true , address=45.91.116.11:4119    , piece_id=RFQEYFWRI542T5TXDE6VJAGEVDF77C54HBHM3RU7YX7EAYTCWQAQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: <nil>
Dec 30 07:13:40.773033281 (591h44m40.644116316s) [seg_pos={0 0}, upload=518755]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:13:40.773304829 (591h44m40.644387924s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EXja3EXj5TJmk2j46Bnc6TXT7N3wgxCLjzAEjbawqvtQU7BF8): protocol: expected piece hash; context canceled; EOF
Dec 30 07:13:40.773322072 (591h44m40.644405117s) [noise=true , address=145.79.227.44:4193   , piece_id=T5QKLPAA4DBVARHDCXWGJXJUW37FMKE52WPZGJEVNNHCDDW3DD4Q, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773394099 (591h44m40.644477144s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34860->77.90.31.11:4553: use of closed network connection
Dec 30 07:13:40.773409117 (591h44m40.644492152s) [noise=true , address=77.90.31.11:4553     , piece_id=UXUBMSTE54AAQPQPJQQ7IDMVDG3Z5UQU5VZQSLPSECRQ5UTTVWDQ, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773559574 (591h44m40.644642619s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51058->45.91.116.7:4009: use of closed network connection
Dec 30 07:13:40.773569353 (591h44m40.644652398s) [noise=true , address=45.91.116.7:4009     , piece_id=E2P6F3LW3O5WAUGLYASLOAGZQ7J5LA253M7V3GWZP7YNWUBEXIXA, seg_pos={0 0}, upload=518755]: Long tail cancellation due to optimal threshold
Dec 30 07:13:40.773599039 (591h44m40.644682084s) [seg_pos={0 0}, upload=518755]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:13:40.773736952 (591h44m40.644819997s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:13:40.773745849 (591h44m40.644828894s) [upload=518755]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:13:41.055474715 (591h44m40.92655776s) [upload=518755]: Done uploading segments...
Dec 30 07:13:41.055497147 (591h44m40.926580182s) [upload=518755]: Upload finished. err: <nil>
Duration: 30.003568401s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [................X...........................................]
duration: 
6.374566453s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:13:56 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 6.374595197s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration: 
32.603716994s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:13:54 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 32.603739467s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
18 out of 60 is failed (threshold=6) [....X..X..X.....X.....X....XXX...XXXX.........X.X.....X..XXX]
duration: 
5.001342379s
trace: 
https://jaeger.dev.storj.io/trace/242361089e7d5848
FAIL (2025-12-30 07:13:52 UTC) 
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001359531s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...................................................X........]
duration: 
25.848329424s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:13:22 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 25.848349793s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
16 out of 60 is failed (threshold=3) [.......X.X.....X....XX...X.....X....XXX..X.....X...X..X.XX..]
duration: 
6.005578241s
trace: 
https://jaeger.dev.storj.io/trace/696b152e7ef4ad15
FAIL (2025-12-30 07:13:17 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, Piece ID: QY3Q5O23BDWFLLNZUHECOOPSJX2CRGB7HECO4ISP6WCYWDOXT45Q) context deadline exceeded; piecestore: (Node ID: 1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy, Piece ID: VBAZWQ2P7TFOXUC5IUWEVNJ45IIPSILMCMMYUT3XIA2VPDSQSXHQ) context deadline exceeded
======LOGS======
c 30 07:11:39.226783636 (591h42m39.097866671s) [upload=518728]: Starting upload
Dec 30 07:11:39.226889207 (591h42m39.097972262s) [upload=518728]: Done starting upload
Dec 30 07:11:39.226954401 (591h42m39.098037446s) [upload=518728]: Uploading segments...
Dec 30 07:11:39.227216200 (591h42m39.098299255s) [upload=518728]: Got next segment. Inline: false
Dec 30 07:11:39.227261025 (591h42m39.09834408s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 07:11:39.227267167 (591h42m39.098350212s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:11:39.473729239 (591h42m39.344812274s) [seg_pos={0 0}, upload=518728]: Begin upload segment...
Dec 30 07:11:39.473788382 (591h42m39.344871417s) [seg_pos={0 0}, upload=518728]: Done begin upload segment.
Dec 30 07:11:39.473837335 (591h42m39.34492037s) [noise=true , address=45.91.116.13:4156    , piece_id=VBAZWQ2P7TFOXUC5IUWEVNJ45IIPSILMCMMYUT3XIA2VPDSQSXHQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.473849539 (591h42m39.344932584s) [noise=true , address=77.90.31.14:4662     , piece_id=QVBP6PS6CJN2BPTPIKKNXDBIGQJRYMRGXFBPKRCWA5KBHN4ACYDA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.474372975 (591h42m39.34545601s) [noise=true , address=145.79.227.11:4732   , piece_id=SKK4BBIENAEPQ4TB7N2XSK5XA6UPQODBVRWH7TLWDI6FFTMP6AOQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.474791051 (591h42m39.345874087s) [noise=true , address=145.79.227.44:4195   , piece_id=LZ66WYB6SLAVKJLB4DZIE2L6H3D47Q75KJOLD47V6JYILABJAOTQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.475316903 (591h42m39.346399938s) [noise=true , address=145.79.227.24:4582   , piece_id=GFQXXSTWDCJL4TSJ3BMSQGC7MVDF5SXHOK2HGSU6U2UVZWS6XGOA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.478275627 (591h42m39.349358672s) [noise=true , address=145.79.227.48:4303   , piece_id=ESGBOUQERXVG2LSNLSBXURH3FQNPM7K4RXKZPYWXTH7QT5S7PK7A, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.484253470 (591h42m39.355336505s) [noise=true , address=77.90.31.16:4735     , piece_id=QY3Q5O23BDWFLLNZUHECOOPSJX2CRGB7HECO4ISP6WCYWDOXT45Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.489034794 (591h42m39.360117829s) [noise=true , address=45.91.116.6:4975     , piece_id=3EWBREX7KAT72FK62TDVSF4FXWJIV6ITB6CY5IOIBJVJJVUXF2VA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.491502984 (591h42m39.362586029s) [noise=true , address=45.91.116.9:4263     , piece_id=66FKR4AAMNJNZOIYKAVM7KQ7XCQUQNQB7R4OLVK5VIS7CIWUKT5Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.493095927 (591h42m39.364178972s) [noise=true , address=45.91.116.14:4189    , piece_id=ULBJD6USULLN73U3KFILYU2GVOVX77H5JJD33FGSLNSAPAFATPWA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.494187405 (591h42m39.36527045s) [noise=true , address=145.79.227.32:4836   , piece_id=FGWCOFNHNM6PYF723FFI7UVASXQL45OUO32IBSZBP6F6HT2CW72Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.495266660 (591h42m39.366349695s) [noise=true , address=145.79.227.38:4979   , piece_id=KM3KX27SSQUQ6CT7HYBEJGLQM2F73IHL6E6CXN437HFYYMTTWBUA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.497048974 (591h42m39.368132019s) [noise=true , address=145.79.227.47:4267   , piece_id=7GJX4PZDRVBEGAIMSMAMWR5RK5CW3DBD7IDFUJ2LPHIX6TPPO77Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.498147075 (591h42m39.36923012s) [noise=true , address=145.79.227.7:4293    , piece_id=KMCWCSSQASKZCFNEOW6GXBNHHUIQNGIAUWZ2WQ4V3XR3RCQ6WWLQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.499022482 (591h42m39.370105517s) [noise=true , address=145.79.227.51:4411   , piece_id=ETGOMDSQNLLP6ZHRC5IEXPLZQEWKECR6ZN2XN7WEWZXUV2IADUSQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.500984608 (591h42m39.372067653s) [noise=true , address=145.79.227.45:4229   , piece_id=DW6CAPAUM7MIQFURQJYJGNL6PYV44DURUOFSDOCOWGYUCL57AFZQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:41.181025198 (591h42m41.052108243s) [upload=518728]: Next returned nil segment
Dec 30 07:11:41.181042160 (591h42m41.052125205s) [upload=518728]: Waiting for error group managing segments...
Dec 30 07:11:41.461601640 (591h42m41.332684675s) [noise=true , address=145.79.227.48:4303   , piece_id=ESGBOUQERXVG2LSNLSBXURH3FQNPM7K4RXKZPYWXTH7QT5S7PK7A, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.464393767 (591h42m41.335476812s) [noise=true , address=145.79.227.24:4582   , piece_id=GFQXXSTWDCJL4TSJ3BMSQGC7MVDF5SXHOK2HGSU6U2UVZWS6XGOA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.480151471 (591h42m41.351234506s) [noise=true , address=145.79.227.7:4293    , piece_id=KMCWCSSQASKZCFNEOW6GXBNHHUIQNGIAUWZ2WQ4V3XR3RCQ6WWLQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.487639770 (591h42m41.358722805s) [noise=true , address=145.79.227.38:4979   , piece_id=KM3KX27SSQUQ6CT7HYBEJGLQM2F73IHL6E6CXN437HFYYMTTWBUA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.495405387 (591h42m41.366488422s) [noise=true , address=145.79.227.32:4836   , piece_id=FGWCOFNHNM6PYF723FFI7UVASXQL45OUO32IBSZBP6F6HT2CW72Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.506061388 (591h42m41.377144423s) [noise=true , address=145.79.227.11:4732   , piece_id=SKK4BBIENAEPQ4TB7N2XSK5XA6UPQODBVRWH7TLWDI6FFTMP6AOQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.507931008 (591h42m41.379014044s) [noise=true , address=145.79.227.51:4411   , piece_id=ETGOMDSQNLLP6ZHRC5IEXPLZQEWKECR6ZN2XN7WEWZXUV2IADUSQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.511049626 (591h42m41.382132661s) [noise=true , address=145.79.227.45:4229   , piece_id=DW6CAPAUM7MIQFURQJYJGNL6PYV44DURUOFSDOCOWGYUCL57AFZQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.526708584 (591h42m41.397791619s) [noise=true , address=145.79.227.47:4267   , piece_id=7GJX4PZDRVBEGAIMSMAMWR5RK5CW3DBD7IDFUJ2LPHIX6TPPO77Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.773342412 (591h42m41.644425457s) [noise=true , address=77.90.31.16:4735     , piece_id=QY3Q5O23BDWFLLNZUHECOOPSJX2CRGB7HECO4ISP6WCYWDOXT45Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.785764526 (591h42m41.656847571s) [noise=true , address=45.91.116.6:4975     , piece_id=3EWBREX7KAT72FK62TDVSF4FXWJIV6ITB6CY5IOIBJVJJVUXF2VA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.909973830 (591h42m41.781056875s) [noise=true , address=45.91.116.13:4156    , piece_id=VBAZWQ2P7TFOXUC5IUWEVNJ45IIPSILMCMMYUT3XIA2VPDSQSXHQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.928253066 (591h42m41.799336111s) [noise=true , address=45.91.116.14:4189    , piece_id=ULBJD6USULLN73U3KFILYU2GVOVX77H5JJD33FGSLNSAPAFATPWA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.928274537 (591h42m41.799357582s) [seg_pos={0 0}, upload=518728]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:11:41.928440804 (591h42m41.799523839s) [noise=true , address=77.90.31.14:4662     , piece_id=QVBP6PS6CJN2BPTPIKKNXDBIGQJRYMRGXFBPKRCWA5KBHN4ACYDA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:48504->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:48504->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48504->77.90.31.14:4662: use of closed network connection
Dec 30 07:11:41.928451083 (591h42m41.799534128s) [noise=true , address=77.90.31.14:4662     , piece_id=QVBP6PS6CJN2BPTPIKKNXDBIGQJRYMRGXFBPKRCWA5KBHN4ACYDA, seg_pos={0 0}, upload=518728]: Long tail cancellation due to optimal threshold
Dec 30 07:11:41.928679227 (591h42m41.799762262s) [noise=true , address=45.91.116.9:4263     , piece_id=66FKR4AAMNJNZOIYKAVM7KQ7XCQUQNQB7R4OLVK5VIS7CIWUKT5Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Dec 30 07:11:41.928685009 (591h42m41.799768044s) [noise=true , address=45.91.116.9:4263     , piece_id=66FKR4AAMNJNZOIYKAVM7KQ7XCQUQNQB7R4OLVK5VIS7CIWUKT5Q, seg_pos={0 0}, upload=518728]: Long tail cancellation due to optimal threshold
Dec 30 07:11:41.928977786 (591h42m41.800060821s) [noise=true , address=145.79.227.44:4195   , piece_id=LZ66WYB6SLAVKJLB4DZIE2L6H3D47Q75KJOLD47V6JYILABJAOTQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cizR87omcPERJsRZt64xHfeQyw6BUpBsJPB2txS4LjZR9StMa): protocol: expected piece hash; context canceled; EOF
Dec 30 07:11:41.928999618 (591h42m41.800082663s) [noise=true , address=145.79.227.44:4195   , piece_id=LZ66WYB6SLAVKJLB4DZIE2L6H3D47Q75KJOLD47V6JYILABJAOTQ, seg_pos={0 0}, upload=518728]: Long tail cancellation due to optimal threshold
Dec 30 07:11:41.929055403 (591h42m41.800138439s) [seg_pos={0 0}, upload=518728]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:11:41.929141157 (591h42m41.800224192s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:11:41.929146958 (591h42m41.800229993s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:11:42.222865284 (591h42m42.093948319s) [upload=518728]: Done uploading segments...
Dec 30 07:11:42.222885713 (591h42m42.093968748s) [upload=518728]: Upload finished. err: <nil>
Duration: 6.005607647s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration: 
9.094901885s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:13:17 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 9.094939377s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
17 out of 60 is failed (threshold=6) [.....X..X..X.....X.....X....XXX...XXXX.........X.X.....X..XX]
duration: 
5.000515063s
trace: 
https://jaeger.dev.storj.io/trace/f8f471caf934381
FAIL (2025-12-30 07:13:05 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.000551644s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration: 
36.367931337s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:12:55 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 36.36795389s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
16 out of 60 is failed (threshold=6) [......X..X..X.....X.....X....XXX...XXXX.........X.X.....X..X]
duration: 
5.001313886s
trace: 
https://jaeger.dev.storj.io/trace/24df1b30d6d241e6
FAIL (2025-12-30 07:12:40 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.001339854s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
17 out of 60 is failed (threshold=3) [X.......X.X.....X....XX...X.....X....XXX..X.....X...X..X.XX.]
duration: 
5.920002932s
trace: 
https://jaeger.dev.storj.io/trace/696b152e7ef4ad15
FAIL (2025-12-30 07:12:30 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, Piece ID: QY3Q5O23BDWFLLNZUHECOOPSJX2CRGB7HECO4ISP6WCYWDOXT45Q) context deadline exceeded; piecestore: (Node ID: 1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy, Piece ID: VBAZWQ2P7TFOXUC5IUWEVNJ45IIPSILMCMMYUT3XIA2VPDSQSXHQ) context deadline exceeded
======LOGS======
c 30 07:11:39.226783636 (591h42m39.097866671s) [upload=518728]: Starting upload
Dec 30 07:11:39.226889207 (591h42m39.097972262s) [upload=518728]: Done starting upload
Dec 30 07:11:39.226954401 (591h42m39.098037446s) [upload=518728]: Uploading segments...
Dec 30 07:11:39.227216200 (591h42m39.098299255s) [upload=518728]: Got next segment. Inline: false
Dec 30 07:11:39.227261025 (591h42m39.09834408s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 07:11:39.227267167 (591h42m39.098350212s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:11:39.473729239 (591h42m39.344812274s) [seg_pos={0 0}, upload=518728]: Begin upload segment...
Dec 30 07:11:39.473788382 (591h42m39.344871417s) [seg_pos={0 0}, upload=518728]: Done begin upload segment.
Dec 30 07:11:39.473837335 (591h42m39.34492037s) [noise=true , address=45.91.116.13:4156    , piece_id=VBAZWQ2P7TFOXUC5IUWEVNJ45IIPSILMCMMYUT3XIA2VPDSQSXHQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.473849539 (591h42m39.344932584s) [noise=true , address=77.90.31.14:4662     , piece_id=QVBP6PS6CJN2BPTPIKKNXDBIGQJRYMRGXFBPKRCWA5KBHN4ACYDA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.474372975 (591h42m39.34545601s) [noise=true , address=145.79.227.11:4732   , piece_id=SKK4BBIENAEPQ4TB7N2XSK5XA6UPQODBVRWH7TLWDI6FFTMP6AOQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.474791051 (591h42m39.345874087s) [noise=true , address=145.79.227.44:4195   , piece_id=LZ66WYB6SLAVKJLB4DZIE2L6H3D47Q75KJOLD47V6JYILABJAOTQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.475316903 (591h42m39.346399938s) [noise=true , address=145.79.227.24:4582   , piece_id=GFQXXSTWDCJL4TSJ3BMSQGC7MVDF5SXHOK2HGSU6U2UVZWS6XGOA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.478275627 (591h42m39.349358672s) [noise=true , address=145.79.227.48:4303   , piece_id=ESGBOUQERXVG2LSNLSBXURH3FQNPM7K4RXKZPYWXTH7QT5S7PK7A, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.484253470 (591h42m39.355336505s) [noise=true , address=77.90.31.16:4735     , piece_id=QY3Q5O23BDWFLLNZUHECOOPSJX2CRGB7HECO4ISP6WCYWDOXT45Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.489034794 (591h42m39.360117829s) [noise=true , address=45.91.116.6:4975     , piece_id=3EWBREX7KAT72FK62TDVSF4FXWJIV6ITB6CY5IOIBJVJJVUXF2VA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.491502984 (591h42m39.362586029s) [noise=true , address=45.91.116.9:4263     , piece_id=66FKR4AAMNJNZOIYKAVM7KQ7XCQUQNQB7R4OLVK5VIS7CIWUKT5Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.493095927 (591h42m39.364178972s) [noise=true , address=45.91.116.14:4189    , piece_id=ULBJD6USULLN73U3KFILYU2GVOVX77H5JJD33FGSLNSAPAFATPWA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.494187405 (591h42m39.36527045s) [noise=true , address=145.79.227.32:4836   , piece_id=FGWCOFNHNM6PYF723FFI7UVASXQL45OUO32IBSZBP6F6HT2CW72Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.495266660 (591h42m39.366349695s) [noise=true , address=145.79.227.38:4979   , piece_id=KM3KX27SSQUQ6CT7HYBEJGLQM2F73IHL6E6CXN437HFYYMTTWBUA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.497048974 (591h42m39.368132019s) [noise=true , address=145.79.227.47:4267   , piece_id=7GJX4PZDRVBEGAIMSMAMWR5RK5CW3DBD7IDFUJ2LPHIX6TPPO77Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.498147075 (591h42m39.36923012s) [noise=true , address=145.79.227.7:4293    , piece_id=KMCWCSSQASKZCFNEOW6GXBNHHUIQNGIAUWZ2WQ4V3XR3RCQ6WWLQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.499022482 (591h42m39.370105517s) [noise=true , address=145.79.227.51:4411   , piece_id=ETGOMDSQNLLP6ZHRC5IEXPLZQEWKECR6ZN2XN7WEWZXUV2IADUSQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.500984608 (591h42m39.372067653s) [noise=true , address=145.79.227.45:4229   , piece_id=DW6CAPAUM7MIQFURQJYJGNL6PYV44DURUOFSDOCOWGYUCL57AFZQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:41.181025198 (591h42m41.052108243s) [upload=518728]: Next returned nil segment
Dec 30 07:11:41.181042160 (591h42m41.052125205s) [upload=518728]: Waiting for error group managing segments...
Dec 30 07:11:41.461601640 (591h42m41.332684675s) [noise=true , address=145.79.227.48:4303   , piece_id=ESGBOUQERXVG2LSNLSBXURH3FQNPM7K4RXKZPYWXTH7QT5S7PK7A, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.464393767 (591h42m41.335476812s) [noise=true , address=145.79.227.24:4582   , piece_id=GFQXXSTWDCJL4TSJ3BMSQGC7MVDF5SXHOK2HGSU6U2UVZWS6XGOA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.480151471 (591h42m41.351234506s) [noise=true , address=145.79.227.7:4293    , piece_id=KMCWCSSQASKZCFNEOW6GXBNHHUIQNGIAUWZ2WQ4V3XR3RCQ6WWLQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.487639770 (591h42m41.358722805s) [noise=true , address=145.79.227.38:4979   , piece_id=KM3KX27SSQUQ6CT7HYBEJGLQM2F73IHL6E6CXN437HFYYMTTWBUA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.495405387 (591h42m41.366488422s) [noise=true , address=145.79.227.32:4836   , piece_id=FGWCOFNHNM6PYF723FFI7UVASXQL45OUO32IBSZBP6F6HT2CW72Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.506061388 (591h42m41.377144423s) [noise=true , address=145.79.227.11:4732   , piece_id=SKK4BBIENAEPQ4TB7N2XSK5XA6UPQODBVRWH7TLWDI6FFTMP6AOQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.507931008 (591h42m41.379014044s) [noise=true , address=145.79.227.51:4411   , piece_id=ETGOMDSQNLLP6ZHRC5IEXPLZQEWKECR6ZN2XN7WEWZXUV2IADUSQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.511049626 (591h42m41.382132661s) [noise=true , address=145.79.227.45:4229   , piece_id=DW6CAPAUM7MIQFURQJYJGNL6PYV44DURUOFSDOCOWGYUCL57AFZQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.526708584 (591h42m41.397791619s) [noise=true , address=145.79.227.47:4267   , piece_id=7GJX4PZDRVBEGAIMSMAMWR5RK5CW3DBD7IDFUJ2LPHIX6TPPO77Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.773342412 (591h42m41.644425457s) [noise=true , address=77.90.31.16:4735     , piece_id=QY3Q5O23BDWFLLNZUHECOOPSJX2CRGB7HECO4ISP6WCYWDOXT45Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.785764526 (591h42m41.656847571s) [noise=true , address=45.91.116.6:4975     , piece_id=3EWBREX7KAT72FK62TDVSF4FXWJIV6ITB6CY5IOIBJVJJVUXF2VA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.909973830 (591h42m41.781056875s) [noise=true , address=45.91.116.13:4156    , piece_id=VBAZWQ2P7TFOXUC5IUWEVNJ45IIPSILMCMMYUT3XIA2VPDSQSXHQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.928253066 (591h42m41.799336111s) [noise=true , address=45.91.116.14:4189    , piece_id=ULBJD6USULLN73U3KFILYU2GVOVX77H5JJD33FGSLNSAPAFATPWA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.928274537 (591h42m41.799357582s) [seg_pos={0 0}, upload=518728]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:11:41.928440804 (591h42m41.799523839s) [noise=true , address=77.90.31.14:4662     , piece_id=QVBP6PS6CJN2BPTPIKKNXDBIGQJRYMRGXFBPKRCWA5KBHN4ACYDA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:48504->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:48504->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48504->77.90.31.14:4662: use of closed network connection
Dec 30 07:11:41.928451083 (591h42m41.799534128s) [noise=true , address=77.90.31.14:4662     , piece_id=QVBP6PS6CJN2BPTPIKKNXDBIGQJRYMRGXFBPKRCWA5KBHN4ACYDA, seg_pos={0 0}, upload=518728]: Long tail cancellation due to optimal threshold
Dec 30 07:11:41.928679227 (591h42m41.799762262s) [noise=true , address=45.91.116.9:4263     , piece_id=66FKR4AAMNJNZOIYKAVM7KQ7XCQUQNQB7R4OLVK5VIS7CIWUKT5Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Dec 30 07:11:41.928685009 (591h42m41.799768044s) [noise=true , address=45.91.116.9:4263     , piece_id=66FKR4AAMNJNZOIYKAVM7KQ7XCQUQNQB7R4OLVK5VIS7CIWUKT5Q, seg_pos={0 0}, upload=518728]: Long tail cancellation due to optimal threshold
Dec 30 07:11:41.928977786 (591h42m41.800060821s) [noise=true , address=145.79.227.44:4195   , piece_id=LZ66WYB6SLAVKJLB4DZIE2L6H3D47Q75KJOLD47V6JYILABJAOTQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cizR87omcPERJsRZt64xHfeQyw6BUpBsJPB2txS4LjZR9StMa): protocol: expected piece hash; context canceled; EOF
Dec 30 07:11:41.928999618 (591h42m41.800082663s) [noise=true , address=145.79.227.44:4195   , piece_id=LZ66WYB6SLAVKJLB4DZIE2L6H3D47Q75KJOLD47V6JYILABJAOTQ, seg_pos={0 0}, upload=518728]: Long tail cancellation due to optimal threshold
Dec 30 07:11:41.929055403 (591h42m41.800138439s) [seg_pos={0 0}, upload=518728]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:11:41.929141157 (591h42m41.800224192s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:11:41.929146958 (591h42m41.800229993s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:11:42.222865284 (591h42m42.093948319s) [upload=518728]: Done uploading segments...
Dec 30 07:11:42.222885713 (591h42m42.093968748s) [upload=518728]: Upload finished. err: <nil>
Duration: 5.920027869s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration: 
6.483196067s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:12:13 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 6.483231725s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
17 out of 60 is failed (threshold=3) [.X.......X.X.....X....XX...X.....X....XXX..X.....X...X..X.XX]
duration: 
30.002979825s
trace: 
https://jaeger.dev.storj.io/trace/696b152e7ef4ad15
FAIL (2025-12-30 07:12:08 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, Piece ID: QY3Q5O23BDWFLLNZUHECOOPSJX2CRGB7HECO4ISP6WCYWDOXT45Q) context deadline exceeded; piecestore: (Node ID: 1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy, Piece ID: VBAZWQ2P7TFOXUC5IUWEVNJ45IIPSILMCMMYUT3XIA2VPDSQSXHQ) context deadline exceeded
======LOGS======
c 30 07:11:39.226783636 (591h42m39.097866671s) [upload=518728]: Starting upload
Dec 30 07:11:39.226889207 (591h42m39.097972262s) [upload=518728]: Done starting upload
Dec 30 07:11:39.226954401 (591h42m39.098037446s) [upload=518728]: Uploading segments...
Dec 30 07:11:39.227216200 (591h42m39.098299255s) [upload=518728]: Got next segment. Inline: false
Dec 30 07:11:39.227261025 (591h42m39.09834408s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 07:11:39.227267167 (591h42m39.098350212s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:11:39.473729239 (591h42m39.344812274s) [seg_pos={0 0}, upload=518728]: Begin upload segment...
Dec 30 07:11:39.473788382 (591h42m39.344871417s) [seg_pos={0 0}, upload=518728]: Done begin upload segment.
Dec 30 07:11:39.473837335 (591h42m39.34492037s) [noise=true , address=45.91.116.13:4156    , piece_id=VBAZWQ2P7TFOXUC5IUWEVNJ45IIPSILMCMMYUT3XIA2VPDSQSXHQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.473849539 (591h42m39.344932584s) [noise=true , address=77.90.31.14:4662     , piece_id=QVBP6PS6CJN2BPTPIKKNXDBIGQJRYMRGXFBPKRCWA5KBHN4ACYDA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.474372975 (591h42m39.34545601s) [noise=true , address=145.79.227.11:4732   , piece_id=SKK4BBIENAEPQ4TB7N2XSK5XA6UPQODBVRWH7TLWDI6FFTMP6AOQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.474791051 (591h42m39.345874087s) [noise=true , address=145.79.227.44:4195   , piece_id=LZ66WYB6SLAVKJLB4DZIE2L6H3D47Q75KJOLD47V6JYILABJAOTQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.475316903 (591h42m39.346399938s) [noise=true , address=145.79.227.24:4582   , piece_id=GFQXXSTWDCJL4TSJ3BMSQGC7MVDF5SXHOK2HGSU6U2UVZWS6XGOA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.478275627 (591h42m39.349358672s) [noise=true , address=145.79.227.48:4303   , piece_id=ESGBOUQERXVG2LSNLSBXURH3FQNPM7K4RXKZPYWXTH7QT5S7PK7A, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.484253470 (591h42m39.355336505s) [noise=true , address=77.90.31.16:4735     , piece_id=QY3Q5O23BDWFLLNZUHECOOPSJX2CRGB7HECO4ISP6WCYWDOXT45Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.489034794 (591h42m39.360117829s) [noise=true , address=45.91.116.6:4975     , piece_id=3EWBREX7KAT72FK62TDVSF4FXWJIV6ITB6CY5IOIBJVJJVUXF2VA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.491502984 (591h42m39.362586029s) [noise=true , address=45.91.116.9:4263     , piece_id=66FKR4AAMNJNZOIYKAVM7KQ7XCQUQNQB7R4OLVK5VIS7CIWUKT5Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.493095927 (591h42m39.364178972s) [noise=true , address=45.91.116.14:4189    , piece_id=ULBJD6USULLN73U3KFILYU2GVOVX77H5JJD33FGSLNSAPAFATPWA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.494187405 (591h42m39.36527045s) [noise=true , address=145.79.227.32:4836   , piece_id=FGWCOFNHNM6PYF723FFI7UVASXQL45OUO32IBSZBP6F6HT2CW72Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.495266660 (591h42m39.366349695s) [noise=true , address=145.79.227.38:4979   , piece_id=KM3KX27SSQUQ6CT7HYBEJGLQM2F73IHL6E6CXN437HFYYMTTWBUA, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.497048974 (591h42m39.368132019s) [noise=true , address=145.79.227.47:4267   , piece_id=7GJX4PZDRVBEGAIMSMAMWR5RK5CW3DBD7IDFUJ2LPHIX6TPPO77Q, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.498147075 (591h42m39.36923012s) [noise=true , address=145.79.227.7:4293    , piece_id=KMCWCSSQASKZCFNEOW6GXBNHHUIQNGIAUWZ2WQ4V3XR3RCQ6WWLQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.499022482 (591h42m39.370105517s) [noise=true , address=145.79.227.51:4411   , piece_id=ETGOMDSQNLLP6ZHRC5IEXPLZQEWKECR6ZN2XN7WEWZXUV2IADUSQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:39.500984608 (591h42m39.372067653s) [noise=true , address=145.79.227.45:4229   , piece_id=DW6CAPAUM7MIQFURQJYJGNL6PYV44DURUOFSDOCOWGYUCL57AFZQ, seg_pos={0 0}, upload=518728]: Uploading piece...
Dec 30 07:11:41.181025198 (591h42m41.052108243s) [upload=518728]: Next returned nil segment
Dec 30 07:11:41.181042160 (591h42m41.052125205s) [upload=518728]: Waiting for error group managing segments...
Dec 30 07:11:41.461601640 (591h42m41.332684675s) [noise=true , address=145.79.227.48:4303   , piece_id=ESGBOUQERXVG2LSNLSBXURH3FQNPM7K4RXKZPYWXTH7QT5S7PK7A, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.464393767 (591h42m41.335476812s) [noise=true , address=145.79.227.24:4582   , piece_id=GFQXXSTWDCJL4TSJ3BMSQGC7MVDF5SXHOK2HGSU6U2UVZWS6XGOA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.480151471 (591h42m41.351234506s) [noise=true , address=145.79.227.7:4293    , piece_id=KMCWCSSQASKZCFNEOW6GXBNHHUIQNGIAUWZ2WQ4V3XR3RCQ6WWLQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.487639770 (591h42m41.358722805s) [noise=true , address=145.79.227.38:4979   , piece_id=KM3KX27SSQUQ6CT7HYBEJGLQM2F73IHL6E6CXN437HFYYMTTWBUA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.495405387 (591h42m41.366488422s) [noise=true , address=145.79.227.32:4836   , piece_id=FGWCOFNHNM6PYF723FFI7UVASXQL45OUO32IBSZBP6F6HT2CW72Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.506061388 (591h42m41.377144423s) [noise=true , address=145.79.227.11:4732   , piece_id=SKK4BBIENAEPQ4TB7N2XSK5XA6UPQODBVRWH7TLWDI6FFTMP6AOQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.507931008 (591h42m41.379014044s) [noise=true , address=145.79.227.51:4411   , piece_id=ETGOMDSQNLLP6ZHRC5IEXPLZQEWKECR6ZN2XN7WEWZXUV2IADUSQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.511049626 (591h42m41.382132661s) [noise=true , address=145.79.227.45:4229   , piece_id=DW6CAPAUM7MIQFURQJYJGNL6PYV44DURUOFSDOCOWGYUCL57AFZQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.526708584 (591h42m41.397791619s) [noise=true , address=145.79.227.47:4267   , piece_id=7GJX4PZDRVBEGAIMSMAMWR5RK5CW3DBD7IDFUJ2LPHIX6TPPO77Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.773342412 (591h42m41.644425457s) [noise=true , address=77.90.31.16:4735     , piece_id=QY3Q5O23BDWFLLNZUHECOOPSJX2CRGB7HECO4ISP6WCYWDOXT45Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.785764526 (591h42m41.656847571s) [noise=true , address=45.91.116.6:4975     , piece_id=3EWBREX7KAT72FK62TDVSF4FXWJIV6ITB6CY5IOIBJVJJVUXF2VA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.909973830 (591h42m41.781056875s) [noise=true , address=45.91.116.13:4156    , piece_id=VBAZWQ2P7TFOXUC5IUWEVNJ45IIPSILMCMMYUT3XIA2VPDSQSXHQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.928253066 (591h42m41.799336111s) [noise=true , address=45.91.116.14:4189    , piece_id=ULBJD6USULLN73U3KFILYU2GVOVX77H5JJD33FGSLNSAPAFATPWA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: <nil>
Dec 30 07:11:41.928274537 (591h42m41.799357582s) [seg_pos={0 0}, upload=518728]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:11:41.928440804 (591h42m41.799523839s) [noise=true , address=77.90.31.14:4662     , piece_id=QVBP6PS6CJN2BPTPIKKNXDBIGQJRYMRGXFBPKRCWA5KBHN4ACYDA, seg_pos={0 0}, upload=518728]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:48504->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:48504->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48504->77.90.31.14:4662: use of closed network connection
Dec 30 07:11:41.928451083 (591h42m41.799534128s) [noise=true , address=77.90.31.14:4662     , piece_id=QVBP6PS6CJN2BPTPIKKNXDBIGQJRYMRGXFBPKRCWA5KBHN4ACYDA, seg_pos={0 0}, upload=518728]: Long tail cancellation due to optimal threshold
Dec 30 07:11:41.928679227 (591h42m41.799762262s) [noise=true , address=45.91.116.9:4263     , piece_id=66FKR4AAMNJNZOIYKAVM7KQ7XCQUQNQB7R4OLVK5VIS7CIWUKT5Q, seg_pos={0 0}, upload=518728]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF
Dec 30 07:11:41.928685009 (591h42m41.799768044s) [noise=true , address=45.91.116.9:4263     , piece_id=66FKR4AAMNJNZOIYKAVM7KQ7XCQUQNQB7R4OLVK5VIS7CIWUKT5Q, seg_pos={0 0}, upload=518728]: Long tail cancellation due to optimal threshold
Dec 30 07:11:41.928977786 (591h42m41.800060821s) [noise=true , address=145.79.227.44:4195   , piece_id=LZ66WYB6SLAVKJLB4DZIE2L6H3D47Q75KJOLD47V6JYILABJAOTQ, seg_pos={0 0}, upload=518728]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cizR87omcPERJsRZt64xHfeQyw6BUpBsJPB2txS4LjZR9StMa): protocol: expected piece hash; context canceled; EOF
Dec 30 07:11:41.928999618 (591h42m41.800082663s) [noise=true , address=145.79.227.44:4195   , piece_id=LZ66WYB6SLAVKJLB4DZIE2L6H3D47Q75KJOLD47V6JYILABJAOTQ, seg_pos={0 0}, upload=518728]: Long tail cancellation due to optimal threshold
Dec 30 07:11:41.929055403 (591h42m41.800138439s) [seg_pos={0 0}, upload=518728]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:11:41.929141157 (591h42m41.800224192s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:11:41.929146958 (591h42m41.800229993s) [upload=518728]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:11:42.222865284 (591h42m42.093948319s) [upload=518728]: Done uploading segments...
Dec 30 07:11:42.222885713 (591h42m42.093968748s) [upload=518728]: Upload finished. err: <nil>
Duration: 30.003006446s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
16 out of 60 is failed (threshold=6) [X......X..X..X.....X.....X....XXX...XXXX.........X.X.....X..]
duration: 
3.811739538s
trace: 
https://jaeger.dev.storj.io/trace/2b45170052295e8a
FAIL (2025-12-30 07:12:05 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.811771439s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration: 
34.334476785s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:11:39 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 34.334510129s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [...................X........................................]
duration: 
6.910654073s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:11:39 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 6.910691093s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
16 out of 60 is failed (threshold=6) [.X......X..X..X.....X.....X....XXX...XXXX.........X.X.....X.]
duration: 
3.646560602s
trace: 
https://jaeger.dev.storj.io/trace/2b45170052295e8a
FAIL (2025-12-30 07:11:32 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.646589126s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
16 out of 60 is failed (threshold=3) [..X.......X.X.....X....XX...X.....X....XXX..X.....X...X..X.X]
duration: 
30.003529576s
trace: 
https://jaeger.dev.storj.io/trace/43061c29e4db83e1
FAIL (2025-12-30 07:11:14 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, Piece ID: 7KKND6ABWVHLJZJPWA3G6TBXJ7TL743JBRNUEBS3WLMLN76MUOSQ) context deadline exceeded; piecestore: (Node ID: 1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, Piece ID: GJBKUCRLWDO354AWJ4F2Q462GKLDN66QWPGZEGXDVJSGL2UKQBYQ) context deadline exceeded; piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: 7YXRBJGVOCQWDWRRJVMA7PXPDJ3CODYXZMCDGKBZUR4RYTDJ6NJA) context deadline exceeded; piecestore: (Node ID: 12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, Piece ID: BUMM4GVZFL67EIIGTADCRP2DGPDSOLIJ533CD7EXTY2ACM2ZLAKA) context deadline exceeded; piecestore: (Node ID: 1QXoPNv44qGgVJZR9oRSmogH4paPpS4HX5jLBJdef1X9ev4stQ, Piece ID: GQKOTGPHD3CXVGWXLKREPKC47FRHAZTDH2RZPMZ3WOXMJRLT2URQ) context deadline exceeded
======LOGS======
segments...
Dec 30 07:10:45.438138393 (591h41m45.309221438s) [upload=518716]: Got next segment. Inline: false
Dec 30 07:10:45.438181194 (591h41m45.309264239s) [upload=518716]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 07:10:45.438187426 (591h41m45.309270471s) [upload=518716]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:10:45.682051512 (591h41m45.553134587s) [seg_pos={0 0}, upload=518716]: Begin upload segment...
Dec 30 07:10:45.682112628 (591h41m45.553195663s) [seg_pos={0 0}, upload=518716]: Done begin upload segment.
Dec 30 07:10:45.682142535 (591h41m45.55322558s) [noise=true , address=45.91.116.6:4975     , piece_id=7KKND6ABWVHLJZJPWA3G6TBXJ7TL743JBRNUEBS3WLMLN76MUOSQ, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.682158667 (591h41m45.553241712s) [noise=true , address=77.90.31.10:4517     , piece_id=GUE3OQ4KP6DW4QD4RQK4R35355CRAMAGSYQA2QY6NUYJM4R6LRVQ, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.682202159 (591h41m45.553285204s) [noise=true , address=145.79.227.25:4617   , piece_id=UPO3S7K64V2OQ5IG4OAUI2F3WBFOGJK3F5QMPFC2KG7X33UNFKPQ, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.683175733 (591h41m45.554258768s) [noise=true , address=45.91.116.7:4009     , piece_id=GJBKUCRLWDO354AWJ4F2Q462GKLDN66QWPGZEGXDVJSGL2UKQBYQ, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.683576726 (591h41m45.554659761s) [noise=true , address=145.79.227.22:4509   , piece_id=EX5BAT2G54BD6FOCIIO6LVT3WL33LFH2P47IMDIECBAFD2WDQB4Q, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.683953604 (591h41m45.555036649s) [noise=true , address=145.79.227.11:4732   , piece_id=NLKJJLTNRWNXUP6R467M7MH5HOH75AVWOSVTCEQF5TWAXSATWFOA, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.684340140 (591h41m45.555423185s) [noise=true , address=145.79.227.6:4257    , piece_id=BUMM4GVZFL67EIIGTADCRP2DGPDSOLIJ533CD7EXTY2ACM2ZLAKA, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.684730703 (591h41m45.555813748s) [noise=true , address=145.79.227.31:4799   , piece_id=7YXRBJGVOCQWDWRRJVMA7PXPDJ3CODYXZMCDGKBZUR4RYTDJ6NJA, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.685195518 (591h41m45.556278563s) [noise=true , address=145.79.227.27:4689   , piece_id=GQKOTGPHD3CXVGWXLKREPKC47FRHAZTDH2RZPMZ3WOXMJRLT2URQ, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.685697144 (591h41m45.556780189s) [noise=true , address=145.79.227.52:4446   , piece_id=OKXMGQJO2BIEEZW7Q4RMCWASUIGJWUFGJ4XFNSHK6VXD4WMMUE3Q, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.686429548 (591h41m45.557512594s) [noise=true , address=145.79.227.45:4230   , piece_id=EV5MAQSWEQO4BQRDUOHNIST6AGBPO4RACRJ3COVPZFBN4P7QOPLA, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.687964571 (591h41m45.559047616s) [noise=true , address=145.79.227.15:4874   , piece_id=4LRNRRHLOU2KVWY27TZGLWN772PHPFS7T4UOKVDDT3EQBYNJ4SMA, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.688539105 (591h41m45.55962215s) [noise=true , address=77.90.31.15:4700     , piece_id=NEQ2XHKGXLBKR2MWTN46TBQ5VWVW7OPLILIIVLHKXSITVSX4U47A, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.690152458 (591h41m45.561235503s) [noise=true , address=145.79.227.10:4401   , piece_id=RG5VV6NCS2PNN6L4AOPNKYK2ZWCFAEHSGUHQXGFUIASYNXTOIQQQ, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.692356745 (591h41m45.56343979s) [noise=true , address=145.79.227.35:4483   , piece_id=MBKS6DIF4ETTV46EJ2OLMPVGTG5FHWYOYPM66AUD55EGJECDIZXA, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:45.694076319 (591h41m45.565159364s) [noise=true , address=45.91.116.10:4082    , piece_id=NHDQU4L6UT2KEVCUUEXRHYTREPR7FFZF7P6WOSFVGRQMFZE5FJTA, seg_pos={0 0}, upload=518716]: Uploading piece...
Dec 30 07:10:47.394165055 (591h41m47.2652481s) [upload=518716]: Next returned nil segment
Dec 30 07:10:47.394182448 (591h41m47.265265483s) [upload=518716]: Waiting for error group managing segments...
Dec 30 07:10:47.668018124 (591h41m47.539101159s) [noise=true , address=145.79.227.52:4446   , piece_id=OKXMGQJO2BIEEZW7Q4RMCWASUIGJWUFGJ4XFNSHK6VXD4WMMUE3Q, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:47.676984538 (591h41m47.548067573s) [noise=true , address=145.79.227.10:4401   , piece_id=RG5VV6NCS2PNN6L4AOPNKYK2ZWCFAEHSGUHQXGFUIASYNXTOIQQQ, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:47.680240076 (591h41m47.551323111s) [noise=true , address=145.79.227.11:4732   , piece_id=NLKJJLTNRWNXUP6R467M7MH5HOH75AVWOSVTCEQF5TWAXSATWFOA, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:47.684008692 (591h41m47.555091737s) [noise=true , address=145.79.227.22:4509   , piece_id=EX5BAT2G54BD6FOCIIO6LVT3WL33LFH2P47IMDIECBAFD2WDQB4Q, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:47.684543710 (591h41m47.555626746s) [noise=true , address=145.79.227.27:4689   , piece_id=GQKOTGPHD3CXVGWXLKREPKC47FRHAZTDH2RZPMZ3WOXMJRLT2URQ, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:47.688552124 (591h41m47.559635169s) [noise=true , address=145.79.227.31:4799   , piece_id=7YXRBJGVOCQWDWRRJVMA7PXPDJ3CODYXZMCDGKBZUR4RYTDJ6NJA, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:47.703112409 (591h41m47.574195444s) [noise=true , address=145.79.227.45:4230   , piece_id=EV5MAQSWEQO4BQRDUOHNIST6AGBPO4RACRJ3COVPZFBN4P7QOPLA, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:47.705084433 (591h41m47.576167479s) [noise=true , address=145.79.227.15:4874   , piece_id=4LRNRRHLOU2KVWY27TZGLWN772PHPFS7T4UOKVDDT3EQBYNJ4SMA, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:47.737547538 (591h41m47.608630583s) [noise=true , address=145.79.227.25:4617   , piece_id=UPO3S7K64V2OQ5IG4OAUI2F3WBFOGJK3F5QMPFC2KG7X33UNFKPQ, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:47.824341588 (591h41m47.695424643s) [noise=true , address=145.79.227.6:4257    , piece_id=BUMM4GVZFL67EIIGTADCRP2DGPDSOLIJ533CD7EXTY2ACM2ZLAKA, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:47.994524353 (591h41m47.865607388s) [noise=true , address=45.91.116.7:4009     , piece_id=GJBKUCRLWDO354AWJ4F2Q462GKLDN66QWPGZEGXDVJSGL2UKQBYQ, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:48.035694698 (591h41m47.906777733s) [noise=true , address=45.91.116.6:4975     , piece_id=7KKND6ABWVHLJZJPWA3G6TBXJ7TL743JBRNUEBS3WLMLN76MUOSQ, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:48.169004371 (591h41m48.040087406s) [noise=true , address=77.90.31.10:4517     , piece_id=GUE3OQ4KP6DW4QD4RQK4R35355CRAMAGSYQA2QY6NUYJM4R6LRVQ, seg_pos={0 0}, upload=518716]: Done uploading piece. err: <nil>
Dec 30 07:10:48.169060498 (591h41m48.040143543s) [seg_pos={0 0}, upload=518716]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:10:48.169221755 (591h41m48.04030479s) [noise=true , address=45.91.116.10:4082    , piece_id=NHDQU4L6UT2KEVCUUEXRHYTREPR7FFZF7P6WOSFVGRQMFZE5FJTA, seg_pos={0 0}, upload=518716]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:48158->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:48158->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48158->45.91.116.10:4082: use of closed network connection
Dec 30 07:10:48.169228377 (591h41m48.040311422s) [noise=true , address=45.91.116.10:4082    , piece_id=NHDQU4L6UT2KEVCUUEXRHYTREPR7FFZF7P6WOSFVGRQMFZE5FJTA, seg_pos={0 0}, upload=518716]: Long tail cancellation due to optimal threshold
Dec 30 07:10:48.169328709 (591h41m48.040411744s) [noise=true , address=145.79.227.35:4483   , piece_id=MBKS6DIF4ETTV46EJ2OLMPVGTG5FHWYOYPM66AUD55EGJECDIZXA, seg_pos={0 0}, upload=518716]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF
Dec 30 07:10:48.169338317 (591h41m48.040421352s) [noise=true , address=145.79.227.35:4483   , piece_id=MBKS6DIF4ETTV46EJ2OLMPVGTG5FHWYOYPM66AUD55EGJECDIZXA, seg_pos={0 0}, upload=518716]: Long tail cancellation due to optimal threshold
Dec 30 07:10:48.169390536 (591h41m48.040473582s) [noise=true , address=77.90.31.15:4700     , piece_id=NEQ2XHKGXLBKR2MWTN46TBQ5VWVW7OPLILIIVLHKXSITVSX4U47A, seg_pos={0 0}, upload=518716]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q): protocol: write tcp 188.166.225.170:36696->77.90.31.15:4700: use of closed network connection; write tcp 188.166.225.170:36696->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36696->77.90.31.15:4700: use of closed network connection
Dec 30 07:10:48.169398852 (591h41m48.040481887s) [noise=true , address=77.90.31.15:4700     , piece_id=NEQ2XHKGXLBKR2MWTN46TBQ5VWVW7OPLILIIVLHKXSITVSX4U47A, seg_pos={0 0}, upload=518716]: Long tail cancellation due to optimal threshold
Dec 30 07:10:48.169417397 (591h41m48.040500432s) [seg_pos={0 0}, upload=518716]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:10:48.169476890 (591h41m48.040559925s) [upload=518716]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:10:48.169481379 (591h41m48.040564414s) [upload=518716]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:10:48.461871646 (591h41m48.332954681s) [upload=518716]: Done uploading segments...
Dec 30 07:10:48.461892446 (591h41m48.332975481s) [upload=518716]: Upload finished. err: <nil>
Duration: 30.00355322s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration: 
30.12421973s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:10:53 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 30.124248214s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
16 out of 60 is failed (threshold=6) [..X......X..X..X.....X.....X....XXX...XXXX.........X.X.....X]
duration: 
5.001295149s
trace: 
https://jaeger.dev.storj.io/trace/2b45170052295e8a
FAIL (2025-12-30 07:10:37 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.001318652s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration: 
7.65508994s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:10:32 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 7.65512111s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration: 
7.631612574s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:10:09 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 7.631743433s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [X......................................................X....]
duration: 
15.295716985s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:10:03 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 15.295781017s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
15 out of 60 is failed (threshold=3) [...X.......X.X.....X....XX...X.....X....XXX..X.....X...X..X.]
duration: 
9.226910807s
trace: 
https://jaeger.dev.storj.io/trace/5e3bdba87d90fcf9
FAIL (2025-12-30 07:09:54 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: JO7TRMSJ7STSJDCEMY6ALZPVPGXDH4DUIIZJJ32ZSJOO43VH24ZA) context deadline exceeded; piecestore: (Node ID: 12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, Piece ID: AB3YU2PWGWNWC7CW7IZMPBFUGMFSFSUZYJUTUOCPLKTY2IW7QM7Q) context deadline exceeded
======LOGS======
Dec 30 07:08:54.289653768 (591h39m54.160736813s) [upload=518685]: Starting upload
Dec 30 07:08:54.289738220 (591h39m54.160821285s) [upload=518685]: Done starting upload
Dec 30 07:08:54.289894777 (591h39m54.160977832s) [upload=518685]: Uploading segments...
Dec 30 07:08:54.290041787 (591h39m54.161124842s) [upload=518685]: Got next segment. Inline: false
Dec 30 07:08:54.290089028 (591h39m54.161172083s) [upload=518685]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 07:08:54.290095850 (591h39m54.161178895s) [upload=518685]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:08:54.531984553 (591h39m54.403067599s) [seg_pos={0 0}, upload=518685]: Begin upload segment...
Dec 30 07:08:54.532048656 (591h39m54.403131701s) [seg_pos={0 0}, upload=518685]: Done begin upload segment.
Dec 30 07:08:54.532090615 (591h39m54.40317365s) [noise=true , address=145.79.227.23:4545   , piece_id=LEDJFN2PHRVLJENERYKDRETDXSD6THWF6UCWIOZJU5EJM5E7GKSA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.532113389 (591h39m54.403196424s) [noise=true , address=45.91.116.5:4299     , piece_id=JO7TRMSJ7STSJDCEMY6ALZPVPGXDH4DUIIZJJ32ZSJOO43VH24ZA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.532676822 (591h39m54.403759857s) [noise=true , address=145.79.227.45:4230   , piece_id=FFYJ2GUXYZZZAPXX2EFRHJ3AQVLB7RXQAXEU2V7IHBVEHWSUON4A, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.533050083 (591h39m54.404133128s) [noise=true , address=145.79.227.17:4970   , piece_id=QN3GC2MY2GHPZJUKBUVVWI3ZW2UAKRPB7WRPC3SQNLBPCNTPU2UQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.533666727 (591h39m54.404749762s) [noise=true , address=77.90.31.14:4664     , piece_id=AB3YU2PWGWNWC7CW7IZMPBFUGMFSFSUZYJUTUOCPLKTY2IW7QM7Q, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.534101825 (591h39m54.40518486s) [noise=true , address=145.79.227.41:4087   , piece_id=SQ6ENTJEUX2GUU3ZZMIDUSH7LJSS4PSMUSFACJWLBURIJHTY5WUA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.534131813 (591h39m54.405214848s) [noise=true , address=145.79.227.22:4509   , piece_id=ZUKN2V2SYMXY26Y45E6GYSF4VYDHLLPWJX64H2UMMOHKKPG57XJA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.534770929 (591h39m54.405853964s) [noise=true , address=145.79.227.37:4567   , piece_id=K3Q5LOZ5YWXHO73HIGMXPL6AQCQVRU4PBOVRPUW2HM6USNZC6YTQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.535252196 (591h39m54.406335241s) [noise=true , address=145.79.227.38:4978   , piece_id=KYX3IYAPVKVAXCNHS767Z3CD3PMZBTJ2KY3R6LIIOWUHWT2L5URA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.535766455 (591h39m54.4068495s) [noise=true , address=145.79.227.12:4765   , piece_id=5R43UZ3JAOLM624FBRMXV3KSHEKQQTVPRIEJRJ3TTTQIGPQ7Z2TA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.537025302 (591h39m54.408108347s) [noise=true , address=145.79.227.14:4839   , piece_id=6OV6JTTBXCWFBVFO4DZHLDJM6VMZFHY5EAMXMZZUGGQJFSSZS2IQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.538502865 (591h39m54.40958592s) [noise=true , address=145.79.227.49:4337   , piece_id=NUWJ3LFHFJXM6IHMIPR64KWYBKHTJ2T3BPAXQ6O5LHU64NUEQFRQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.540769672 (591h39m54.411852718s) [noise=true , address=145.79.227.46:4603   , piece_id=G2PUZTLL5MLOJMNAMPQRQ2JIDYDSUWAREQ4TTE2WZAZ3H5MHM6XQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.542312640 (591h39m54.413395685s) [noise=true , address=45.91.116.8:4045     , piece_id=6IKHDDK37AJSVL3YOZBIJQEKDKTF2GLSW66SHJUCFHIKHHQDE6SQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.544186138 (591h39m54.415269173s) [noise=true , address=145.79.227.43:4158   , piece_id=CHQI4E7MT767WDKBNECBRSVBOO6YQPYPAFNB3P6NFUJPTWLVCV3A, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.548396014 (591h39m54.419479049s) [noise=true , address=145.79.227.8:4331    , piece_id=EJJPQXAZ2DH7PCTEVP6M7OIMET44VAKRQVRGMTQVUHZIMBURPTPA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:56.233337824 (591h39m56.10442086s) [upload=518685]: Next returned nil segment
Dec 30 07:08:56.233352413 (591h39m56.104435458s) [upload=518685]: Waiting for error group managing segments...
Dec 30 07:08:56.513568337 (591h39m56.384651382s) [noise=true , address=145.79.227.45:4230   , piece_id=FFYJ2GUXYZZZAPXX2EFRHJ3AQVLB7RXQAXEU2V7IHBVEHWSUON4A, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.520215624 (591h39m56.391298669s) [noise=true , address=145.79.227.22:4509   , piece_id=ZUKN2V2SYMXY26Y45E6GYSF4VYDHLLPWJX64H2UMMOHKKPG57XJA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.526874944 (591h39m56.39795798s) [noise=true , address=145.79.227.37:4567   , piece_id=K3Q5LOZ5YWXHO73HIGMXPL6AQCQVRU4PBOVRPUW2HM6USNZC6YTQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.535155402 (591h39m56.406238447s) [noise=true , address=145.79.227.41:4087   , piece_id=SQ6ENTJEUX2GUU3ZZMIDUSH7LJSS4PSMUSFACJWLBURIJHTY5WUA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.535860054 (591h39m56.406943089s) [noise=true , address=145.79.227.12:4765   , piece_id=5R43UZ3JAOLM624FBRMXV3KSHEKQQTVPRIEJRJ3TTTQIGPQ7Z2TA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.541074012 (591h39m56.412157047s) [noise=true , address=145.79.227.8:4331    , piece_id=EJJPQXAZ2DH7PCTEVP6M7OIMET44VAKRQVRGMTQVUHZIMBURPTPA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.548103957 (591h39m56.419187002s) [noise=true , address=145.79.227.46:4603   , piece_id=G2PUZTLL5MLOJMNAMPQRQ2JIDYDSUWAREQ4TTE2WZAZ3H5MHM6XQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.548222604 (591h39m56.419305649s) [noise=true , address=145.79.227.17:4970   , piece_id=QN3GC2MY2GHPZJUKBUVVWI3ZW2UAKRPB7WRPC3SQNLBPCNTPU2UQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.552711071 (591h39m56.423794106s) [noise=true , address=145.79.227.14:4839   , piece_id=6OV6JTTBXCWFBVFO4DZHLDJM6VMZFHY5EAMXMZZUGGQJFSSZS2IQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.554968349 (591h39m56.426051384s) [noise=true , address=145.79.227.38:4978   , piece_id=KYX3IYAPVKVAXCNHS767Z3CD3PMZBTJ2KY3R6LIIOWUHWT2L5URA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.568835284 (591h39m56.439918329s) [noise=true , address=145.79.227.23:4545   , piece_id=LEDJFN2PHRVLJENERYKDRETDXSD6THWF6UCWIOZJU5EJM5E7GKSA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.813415722 (591h39m56.684498767s) [noise=true , address=77.90.31.14:4664     , piece_id=AB3YU2PWGWNWC7CW7IZMPBFUGMFSFSUZYJUTUOCPLKTY2IW7QM7Q, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.890180043 (591h39m56.761263088s) [noise=true , address=45.91.116.5:4299     , piece_id=JO7TRMSJ7STSJDCEMY6ALZPVPGXDH4DUIIZJJ32ZSJOO43VH24ZA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.890204139 (591h39m56.761287184s) [seg_pos={0 0}, upload=518685]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:08:56.890546310 (591h39m56.761629356s) [noise=true , address=145.79.227.43:4158   , piece_id=CHQI4E7MT767WDKBNECBRSVBOO6YQPYPAFNB3P6NFUJPTWLVCV3A, seg_pos={0 0}, upload=518685]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2): protocol: expected piece hash; context canceled; EOF
Dec 30 07:08:56.890555357 (591h39m56.761638402s) [noise=true , address=145.79.227.43:4158   , piece_id=CHQI4E7MT767WDKBNECBRSVBOO6YQPYPAFNB3P6NFUJPTWLVCV3A, seg_pos={0 0}, upload=518685]: Long tail cancellation due to optimal threshold
Dec 30 07:08:56.890697678 (591h39m56.761780713s) [noise=true , address=45.91.116.8:4045     , piece_id=6IKHDDK37AJSVL3YOZBIJQEKDKTF2GLSW66SHJUCFHIKHHQDE6SQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF
Dec 30 07:08:56.890703990 (591h39m56.761787035s) [noise=true , address=45.91.116.8:4045     , piece_id=6IKHDDK37AJSVL3YOZBIJQEKDKTF2GLSW66SHJUCFHIKHHQDE6SQ, seg_pos={0 0}, upload=518685]: Long tail cancellation due to optimal threshold
Dec 30 07:08:56.890956471 (591h39m56.762039516s) [noise=true , address=145.79.227.49:4337   , piece_id=NUWJ3LFHFJXM6IHMIPR64KWYBKHTJ2T3BPAXQ6O5LHU64NUEQFRQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: expected piece hash; context canceled; EOF
Dec 30 07:08:56.890978323 (591h39m56.762061368s) [noise=true , address=145.79.227.49:4337   , piece_id=NUWJ3LFHFJXM6IHMIPR64KWYBKHTJ2T3BPAXQ6O5LHU64NUEQFRQ, seg_pos={0 0}, upload=518685]: Long tail cancellation due to optimal threshold
Dec 30 07:08:56.891023328 (591h39m56.762106363s) [seg_pos={0 0}, upload=518685]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:08:56.891133108 (591h39m56.762216153s) [upload=518685]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:08:56.891139290 (591h39m56.762222325s) [upload=518685]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:08:57.181052599 (591h39m57.052135644s) [upload=518685]: Done uploading segments...
Dec 30 07:08:57.181076435 (591h39m57.05215949s) [upload=518685]: Upload finished. err: <nil>
Duration: 9.226934854s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
15 out of 60 is failed (threshold=6) [...X......X..X..X.....X.....X....XXX...XXXX.........X.X.....]
duration: 
4.423848878s
trace: 
https://jaeger.dev.storj.io/trace/592f4831f086b12d
FAIL (2025-12-30 07:09:40 UTC) 
orbiter warning: context deadline exceeded
Duration: 4.423864259s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration: 
7.159685784s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:09:38 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 7.15971054s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
15 out of 60 is failed (threshold=3) [....X.......X.X.....X....XX...X.....X....XXX..X.....X...X..X]
duration: 
30.003177508s
trace: 
https://jaeger.dev.storj.io/trace/5e3bdba87d90fcf9
FAIL (2025-12-30 07:09:23 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: JO7TRMSJ7STSJDCEMY6ALZPVPGXDH4DUIIZJJ32ZSJOO43VH24ZA) context deadline exceeded; piecestore: (Node ID: 12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, Piece ID: AB3YU2PWGWNWC7CW7IZMPBFUGMFSFSUZYJUTUOCPLKTY2IW7QM7Q) context deadline exceeded
======LOGS======
Dec 30 07:08:54.289653768 (591h39m54.160736813s) [upload=518685]: Starting upload
Dec 30 07:08:54.289738220 (591h39m54.160821285s) [upload=518685]: Done starting upload
Dec 30 07:08:54.289894777 (591h39m54.160977832s) [upload=518685]: Uploading segments...
Dec 30 07:08:54.290041787 (591h39m54.161124842s) [upload=518685]: Got next segment. Inline: false
Dec 30 07:08:54.290089028 (591h39m54.161172083s) [upload=518685]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 07:08:54.290095850 (591h39m54.161178895s) [upload=518685]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:08:54.531984553 (591h39m54.403067599s) [seg_pos={0 0}, upload=518685]: Begin upload segment...
Dec 30 07:08:54.532048656 (591h39m54.403131701s) [seg_pos={0 0}, upload=518685]: Done begin upload segment.
Dec 30 07:08:54.532090615 (591h39m54.40317365s) [noise=true , address=145.79.227.23:4545   , piece_id=LEDJFN2PHRVLJENERYKDRETDXSD6THWF6UCWIOZJU5EJM5E7GKSA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.532113389 (591h39m54.403196424s) [noise=true , address=45.91.116.5:4299     , piece_id=JO7TRMSJ7STSJDCEMY6ALZPVPGXDH4DUIIZJJ32ZSJOO43VH24ZA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.532676822 (591h39m54.403759857s) [noise=true , address=145.79.227.45:4230   , piece_id=FFYJ2GUXYZZZAPXX2EFRHJ3AQVLB7RXQAXEU2V7IHBVEHWSUON4A, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.533050083 (591h39m54.404133128s) [noise=true , address=145.79.227.17:4970   , piece_id=QN3GC2MY2GHPZJUKBUVVWI3ZW2UAKRPB7WRPC3SQNLBPCNTPU2UQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.533666727 (591h39m54.404749762s) [noise=true , address=77.90.31.14:4664     , piece_id=AB3YU2PWGWNWC7CW7IZMPBFUGMFSFSUZYJUTUOCPLKTY2IW7QM7Q, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.534101825 (591h39m54.40518486s) [noise=true , address=145.79.227.41:4087   , piece_id=SQ6ENTJEUX2GUU3ZZMIDUSH7LJSS4PSMUSFACJWLBURIJHTY5WUA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.534131813 (591h39m54.405214848s) [noise=true , address=145.79.227.22:4509   , piece_id=ZUKN2V2SYMXY26Y45E6GYSF4VYDHLLPWJX64H2UMMOHKKPG57XJA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.534770929 (591h39m54.405853964s) [noise=true , address=145.79.227.37:4567   , piece_id=K3Q5LOZ5YWXHO73HIGMXPL6AQCQVRU4PBOVRPUW2HM6USNZC6YTQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.535252196 (591h39m54.406335241s) [noise=true , address=145.79.227.38:4978   , piece_id=KYX3IYAPVKVAXCNHS767Z3CD3PMZBTJ2KY3R6LIIOWUHWT2L5URA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.535766455 (591h39m54.4068495s) [noise=true , address=145.79.227.12:4765   , piece_id=5R43UZ3JAOLM624FBRMXV3KSHEKQQTVPRIEJRJ3TTTQIGPQ7Z2TA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.537025302 (591h39m54.408108347s) [noise=true , address=145.79.227.14:4839   , piece_id=6OV6JTTBXCWFBVFO4DZHLDJM6VMZFHY5EAMXMZZUGGQJFSSZS2IQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.538502865 (591h39m54.40958592s) [noise=true , address=145.79.227.49:4337   , piece_id=NUWJ3LFHFJXM6IHMIPR64KWYBKHTJ2T3BPAXQ6O5LHU64NUEQFRQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.540769672 (591h39m54.411852718s) [noise=true , address=145.79.227.46:4603   , piece_id=G2PUZTLL5MLOJMNAMPQRQ2JIDYDSUWAREQ4TTE2WZAZ3H5MHM6XQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.542312640 (591h39m54.413395685s) [noise=true , address=45.91.116.8:4045     , piece_id=6IKHDDK37AJSVL3YOZBIJQEKDKTF2GLSW66SHJUCFHIKHHQDE6SQ, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.544186138 (591h39m54.415269173s) [noise=true , address=145.79.227.43:4158   , piece_id=CHQI4E7MT767WDKBNECBRSVBOO6YQPYPAFNB3P6NFUJPTWLVCV3A, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:54.548396014 (591h39m54.419479049s) [noise=true , address=145.79.227.8:4331    , piece_id=EJJPQXAZ2DH7PCTEVP6M7OIMET44VAKRQVRGMTQVUHZIMBURPTPA, seg_pos={0 0}, upload=518685]: Uploading piece...
Dec 30 07:08:56.233337824 (591h39m56.10442086s) [upload=518685]: Next returned nil segment
Dec 30 07:08:56.233352413 (591h39m56.104435458s) [upload=518685]: Waiting for error group managing segments...
Dec 30 07:08:56.513568337 (591h39m56.384651382s) [noise=true , address=145.79.227.45:4230   , piece_id=FFYJ2GUXYZZZAPXX2EFRHJ3AQVLB7RXQAXEU2V7IHBVEHWSUON4A, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.520215624 (591h39m56.391298669s) [noise=true , address=145.79.227.22:4509   , piece_id=ZUKN2V2SYMXY26Y45E6GYSF4VYDHLLPWJX64H2UMMOHKKPG57XJA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.526874944 (591h39m56.39795798s) [noise=true , address=145.79.227.37:4567   , piece_id=K3Q5LOZ5YWXHO73HIGMXPL6AQCQVRU4PBOVRPUW2HM6USNZC6YTQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.535155402 (591h39m56.406238447s) [noise=true , address=145.79.227.41:4087   , piece_id=SQ6ENTJEUX2GUU3ZZMIDUSH7LJSS4PSMUSFACJWLBURIJHTY5WUA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.535860054 (591h39m56.406943089s) [noise=true , address=145.79.227.12:4765   , piece_id=5R43UZ3JAOLM624FBRMXV3KSHEKQQTVPRIEJRJ3TTTQIGPQ7Z2TA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.541074012 (591h39m56.412157047s) [noise=true , address=145.79.227.8:4331    , piece_id=EJJPQXAZ2DH7PCTEVP6M7OIMET44VAKRQVRGMTQVUHZIMBURPTPA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.548103957 (591h39m56.419187002s) [noise=true , address=145.79.227.46:4603   , piece_id=G2PUZTLL5MLOJMNAMPQRQ2JIDYDSUWAREQ4TTE2WZAZ3H5MHM6XQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.548222604 (591h39m56.419305649s) [noise=true , address=145.79.227.17:4970   , piece_id=QN3GC2MY2GHPZJUKBUVVWI3ZW2UAKRPB7WRPC3SQNLBPCNTPU2UQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.552711071 (591h39m56.423794106s) [noise=true , address=145.79.227.14:4839   , piece_id=6OV6JTTBXCWFBVFO4DZHLDJM6VMZFHY5EAMXMZZUGGQJFSSZS2IQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.554968349 (591h39m56.426051384s) [noise=true , address=145.79.227.38:4978   , piece_id=KYX3IYAPVKVAXCNHS767Z3CD3PMZBTJ2KY3R6LIIOWUHWT2L5URA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.568835284 (591h39m56.439918329s) [noise=true , address=145.79.227.23:4545   , piece_id=LEDJFN2PHRVLJENERYKDRETDXSD6THWF6UCWIOZJU5EJM5E7GKSA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.813415722 (591h39m56.684498767s) [noise=true , address=77.90.31.14:4664     , piece_id=AB3YU2PWGWNWC7CW7IZMPBFUGMFSFSUZYJUTUOCPLKTY2IW7QM7Q, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.890180043 (591h39m56.761263088s) [noise=true , address=45.91.116.5:4299     , piece_id=JO7TRMSJ7STSJDCEMY6ALZPVPGXDH4DUIIZJJ32ZSJOO43VH24ZA, seg_pos={0 0}, upload=518685]: Done uploading piece. err: <nil>
Dec 30 07:08:56.890204139 (591h39m56.761287184s) [seg_pos={0 0}, upload=518685]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:08:56.890546310 (591h39m56.761629356s) [noise=true , address=145.79.227.43:4158   , piece_id=CHQI4E7MT767WDKBNECBRSVBOO6YQPYPAFNB3P6NFUJPTWLVCV3A, seg_pos={0 0}, upload=518685]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vJZrSvPvwebw9V2tTbvkPEmLeLjryBUnq9TL6NwdPsHU9xcq2): protocol: expected piece hash; context canceled; EOF
Dec 30 07:08:56.890555357 (591h39m56.761638402s) [noise=true , address=145.79.227.43:4158   , piece_id=CHQI4E7MT767WDKBNECBRSVBOO6YQPYPAFNB3P6NFUJPTWLVCV3A, seg_pos={0 0}, upload=518685]: Long tail cancellation due to optimal threshold
Dec 30 07:08:56.890697678 (591h39m56.761780713s) [noise=true , address=45.91.116.8:4045     , piece_id=6IKHDDK37AJSVL3YOZBIJQEKDKTF2GLSW66SHJUCFHIKHHQDE6SQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF
Dec 30 07:08:56.890703990 (591h39m56.761787035s) [noise=true , address=45.91.116.8:4045     , piece_id=6IKHDDK37AJSVL3YOZBIJQEKDKTF2GLSW66SHJUCFHIKHHQDE6SQ, seg_pos={0 0}, upload=518685]: Long tail cancellation due to optimal threshold
Dec 30 07:08:56.890956471 (591h39m56.762039516s) [noise=true , address=145.79.227.49:4337   , piece_id=NUWJ3LFHFJXM6IHMIPR64KWYBKHTJ2T3BPAXQ6O5LHU64NUEQFRQ, seg_pos={0 0}, upload=518685]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: expected piece hash; context canceled; EOF
Dec 30 07:08:56.890978323 (591h39m56.762061368s) [noise=true , address=145.79.227.49:4337   , piece_id=NUWJ3LFHFJXM6IHMIPR64KWYBKHTJ2T3BPAXQ6O5LHU64NUEQFRQ, seg_pos={0 0}, upload=518685]: Long tail cancellation due to optimal threshold
Dec 30 07:08:56.891023328 (591h39m56.762106363s) [seg_pos={0 0}, upload=518685]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:08:56.891133108 (591h39m56.762216153s) [upload=518685]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:08:56.891139290 (591h39m56.762222325s) [upload=518685]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:08:57.181052599 (591h39m57.052135644s) [upload=518685]: Done uploading segments...
Dec 30 07:08:57.181076435 (591h39m57.05215949s) [upload=518685]: Upload finished. err: <nil>
Duration: 30.003202406s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.X......................................................X...]
duration: 
30.001650748s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:09:19 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 30.001676657s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
16 out of 60 is failed (threshold=6) [X...X......X..X..X.....X.....X....XXX...XXXX.........X.X....]
duration: 
4.543071609s
trace: 
https://jaeger.dev.storj.io/trace/592f4831f086b12d
FAIL (2025-12-30 07:09:05 UTC) 
orbiter warning: context deadline exceeded
Duration: 4.543122777s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration: 
6.74437906s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:09:01 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 6.74440533s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
14 out of 60 is failed (threshold=3) [.....X.......X.X.....X....XX...X.....X....XXX..X.....X...X..]
duration: 
5.721817305s
trace: 
https://jaeger.dev.storj.io/trace/8eeb125f896a5b3
FAIL (2025-12-30 07:08:38 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
764191 (591h38m12.297847226s) [upload=518661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:07:12.675629259 (591h38m12.546712324s) [seg_pos={0 0}, upload=518661]: Begin upload segment...
Dec 30 07:07:12.675694573 (591h38m12.546777618s) [seg_pos={0 0}, upload=518661]: Done begin upload segment.
Dec 30 07:07:12.675737895 (591h38m12.546820931s) [noise=true , address=145.79.227.39:4015   , piece_id=P7HH7EHEMMLVHOMIZAEUWYVTY5OTYRBOZ7CKZGA75625ZBBKQHVQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.675762292 (591h38m12.546845327s) [noise=true , address=145.79.227.16:4910   , piece_id=2ZWZ4NNDX5SAYTQ6L42PMTZGFQEAN57T5B2M3ZOP5ROA4QNY777Q, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.676382714 (591h38m12.547465759s) [noise=true , address=45.91.116.6:4975     , piece_id=MLO5RXEGU4GDRHOX2QJQM44N6YT7MPADPX2JQDXWMEY7L7T33WDA, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.676788356 (591h38m12.547871401s) [noise=true , address=145.79.227.14:4838   , piece_id=LN6KEVKJG6LFVEJMWFGELDIRDW2HBQRVCTYVFEFR7QHHQW6J22GA, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.677147680 (591h38m12.548230725s) [noise=true , address=145.79.227.17:4970   , piece_id=4KYAMRP5B5ZKURR7NW42KM2VY6OZ47ALVAJ6TFKBNIGBLJMVONUQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.677593188 (591h38m12.548676233s) [noise=true , address=45.91.116.11:4120    , piece_id=HD3KJHF7QSDP3X6JSIUFLPRGIJ275HHNDH6AXXAP7ATDQZHIQTDQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.678062893 (591h38m12.549145928s) [noise=true , address=145.79.227.19:4077   , piece_id=WEPMAELFUB5XHMNXF2TTN6ZJBHX2MUFTNVMXINRUYNILHZFZQ7TQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.678663566 (591h38m12.549746611s) [noise=true , address=77.90.31.16:4735     , piece_id=BLFBKMN6L26IMBFFG6JQX66ZIT2Z7B6GSMUIGRKR4UHR5N6RE53A, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.679086572 (591h38m12.550169617s) [noise=true , address=145.79.227.21:4475   , piece_id=63J2HFZKGWVEAQ7IJSXQDEYVS7LJJBY2RHSQPF6URCQTUYDPB26A, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.680368603 (591h38m12.551451638s) [noise=true , address=77.90.31.18:4808     , piece_id=CZA4RFW5LJ67AP6OZ5IXS7OKKXOI5OOQIW4XJMI6ZURLGJY6FVUA, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.681778929 (591h38m12.552861974s) [noise=true , address=145.79.227.9:4367    , piece_id=PVD66U2AS32VFSOXCP5MLPZEWK6GJJROHMN77MHWZZNXF7QOLR3Q, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.683688956 (591h38m12.554772001s) [noise=true , address=145.79.227.32:4834   , piece_id=MUAW3TTEC2MCOZPUUPSOY72HO4FIERJ7H5V3SSZFNANDHYFNOFRA, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.685982012 (591h38m12.557065057s) [noise=true , address=145.79.227.11:4730   , piece_id=7NKP2QYTVX5R6AR2X5ZMOXXAKMXUVEVIA3WCXOXAG6IRYU6ICG3Q, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.689043131 (591h38m12.560126166s) [noise=true , address=145.79.227.2:4115    , piece_id=FGULHLCRG36PVSVB6SGGKYDV4CISURBU6PFEHXFMF2RAI4UMRWFQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.692211624 (591h38m12.563294669s) [noise=true , address=145.79.227.48:4302   , piece_id=KI3F3YOC3SQFMN4NUOIJLI7PHWUCRE66MDOSPJ5IRTYIN5CH752Q, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.692822517 (591h38m12.563905552s) [noise=true , address=77.90.31.11:4555     , piece_id=RHUEJHWRHKQIPE6QDZHIK7EQH6NPOZUY4N4WJOUHPICQYIXVTZBQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:14.379433447 (591h38m14.250516492s) [upload=518661]: Next returned nil segment
Dec 30 07:07:14.379460639 (591h38m14.250543674s) [upload=518661]: Waiting for error group managing segments...
Dec 30 07:07:14.652296722 (591h38m14.523379767s) [noise=true , address=145.79.227.21:4475   , piece_id=63J2HFZKGWVEAQ7IJSXQDEYVS7LJJBY2RHSQPF6URCQTUYDPB26A, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.665685326 (591h38m14.536768361s) [noise=true , address=145.79.227.14:4838   , piece_id=LN6KEVKJG6LFVEJMWFGELDIRDW2HBQRVCTYVFEFR7QHHQW6J22GA, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.671157856 (591h38m14.542240891s) [noise=true , address=145.79.227.39:4015   , piece_id=P7HH7EHEMMLVHOMIZAEUWYVTY5OTYRBOZ7CKZGA75625ZBBKQHVQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.680810998 (591h38m14.551894043s) [noise=true , address=145.79.227.9:4367    , piece_id=PVD66U2AS32VFSOXCP5MLPZEWK6GJJROHMN77MHWZZNXF7QOLR3Q, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.684231100 (591h38m14.555314145s) [noise=true , address=145.79.227.11:4730   , piece_id=7NKP2QYTVX5R6AR2X5ZMOXXAKMXUVEVIA3WCXOXAG6IRYU6ICG3Q, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.684872801 (591h38m14.555955846s) [noise=true , address=145.79.227.32:4834   , piece_id=MUAW3TTEC2MCOZPUUPSOY72HO4FIERJ7H5V3SSZFNANDHYFNOFRA, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.697728480 (591h38m14.568811525s) [noise=true , address=145.79.227.48:4302   , piece_id=KI3F3YOC3SQFMN4NUOIJLI7PHWUCRE66MDOSPJ5IRTYIN5CH752Q, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.697931317 (591h38m14.569014352s) [noise=true , address=145.79.227.19:4077   , piece_id=WEPMAELFUB5XHMNXF2TTN6ZJBHX2MUFTNVMXINRUYNILHZFZQ7TQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.700481092 (591h38m14.571564137s) [noise=true , address=145.79.227.16:4910   , piece_id=2ZWZ4NNDX5SAYTQ6L42PMTZGFQEAN57T5B2M3ZOP5ROA4QNY777Q, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.750214011 (591h38m14.621297066s) [noise=true , address=145.79.227.2:4115    , piece_id=FGULHLCRG36PVSVB6SGGKYDV4CISURBU6PFEHXFMF2RAI4UMRWFQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.752413710 (591h38m14.623496755s) [noise=true , address=145.79.227.17:4970   , piece_id=4KYAMRP5B5ZKURR7NW42KM2VY6OZ47ALVAJ6TFKBNIGBLJMVONUQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.854173517 (591h38m14.725256552s) [noise=true , address=77.90.31.16:4735     , piece_id=BLFBKMN6L26IMBFFG6JQX66ZIT2Z7B6GSMUIGRKR4UHR5N6RE53A, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.893691125 (591h38m14.76477417s) [noise=true , address=77.90.31.18:4808     , piece_id=CZA4RFW5LJ67AP6OZ5IXS7OKKXOI5OOQIW4XJMI6ZURLGJY6FVUA, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.893713817 (591h38m14.764796852s) [seg_pos={0 0}, upload=518661]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:07:14.893949216 (591h38m14.765032261s) [noise=true , address=77.90.31.11:4555     , piece_id=RHUEJHWRHKQIPE6QDZHIK7EQH6NPOZUY4N4WJOUHPICQYIXVTZBQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: write tcp 188.166.225.170:37822->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:37822->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37822->77.90.31.11:4555: use of closed network connection
Dec 30 07:07:14.893956369 (591h38m14.765039404s) [noise=true , address=77.90.31.11:4555     , piece_id=RHUEJHWRHKQIPE6QDZHIK7EQH6NPOZUY4N4WJOUHPICQYIXVTZBQ, seg_pos={0 0}, upload=518661]: Long tail cancellation due to optimal threshold
Dec 30 07:07:14.894019309 (591h38m14.765102344s) [noise=true , address=45.91.116.6:4975     , piece_id=MLO5RXEGU4GDRHOX2QJQM44N6YT7MPADPX2JQDXWMEY7L7T33WDA, seg_pos={0 0}, upload=518661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: write tcp 188.166.225.170:51554->45.91.116.6:4975: use of closed network connection; write tcp 188.166.225.170:51554->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->45.91.116.6:4975: use of closed network connection
Dec 30 07:07:14.894034879 (591h38m14.765117914s) [noise=true , address=45.91.116.6:4975     , piece_id=MLO5RXEGU4GDRHOX2QJQM44N6YT7MPADPX2JQDXWMEY7L7T33WDA, seg_pos={0 0}, upload=518661]: Long tail cancellation due to optimal threshold
Dec 30 07:07:14.894067161 (591h38m14.765150206s) [noise=true , address=45.91.116.11:4120    , piece_id=HD3KJHF7QSDP3X6JSIUFLPRGIJ275HHNDH6AXXAP7ATDQZHIQTDQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: write tcp 188.166.225.170:36546->45.91.116.11:4120: use of closed network connection; write tcp 188.166.225.170:36546->45.91.116.11:4120: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36546->45.91.116.11:4120: use of closed network connection
Dec 30 07:07:14.894073563 (591h38m14.765156608s) [noise=true , address=45.91.116.11:4120    , piece_id=HD3KJHF7QSDP3X6JSIUFLPRGIJ275HHNDH6AXXAP7ATDQZHIQTDQ, seg_pos={0 0}, upload=518661]: Long tail cancellation due to optimal threshold
Dec 30 07:07:14.894168092 (591h38m14.765251127s) [seg_pos={0 0}, upload=518661]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:07:14.894329470 (591h38m14.765412505s) [upload=518661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:07:14.894334960 (591h38m14.765418005s) [upload=518661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:07:15.192917548 (591h38m15.064000583s) [upload=518661]: Done uploading segments...
Dec 30 07:07:15.192936164 (591h38m15.064019199s) [upload=518661]: Upload finished. err: <nil>
Duration: 5.721844077s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [..X......................................................X..]
duration: 
39.604941134s
trace: 
https://jaeger.dev.storj.io/trace/1d0a2f93cb06aaa4
FAIL (2025-12-30 07:08:36 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
loading piece...
Dec 30 07:06:00.467281687 (591h37m0.338364722s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.467716555 (591h37m0.33879959s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468044320 (591h37m0.339127365s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468308362 (591h37m0.339391407s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468565703 (591h37m0.339648748s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.468843542 (591h37m0.339926587s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.469105310 (591h37m0.340188345s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470034750 (591h37m0.341117795s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470487622 (591h37m0.341570657s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.470809334 (591h37m0.341892379s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471118874 (591h37m0.342201919s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471431078 (591h37m0.342514113s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.471741530 (591h37m0.342824575s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:00.472073311 (591h37m0.343156356s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Uploading piece...
Dec 30 07:06:01.899399345 (591h37m1.77048239s) [upload=518641]: Next returned nil segment
Dec 30 07:06:01.899418712 (591h37m1.770501747s) [upload=518641]: Waiting for error group managing segments...
Dec 30 07:06:02.323303785 (591h37m2.194386821s) [noise=true , address=145.79.227.46:4604   , piece_id=NY5A6JZW4F6E4CSX3ERMKSAL2R3IYSKQ2EVHZSPF6ZOHWQFXBYWA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.339689637 (591h37m2.210772682s) [noise=true , address=145.79.227.17:4000   , piece_id=KN3NDKB4NODHNXUWWQQ4YBWBPJCNE7YHYEMLQ4UITRCFZB4BRSMA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.346460570 (591h37m2.217543615s) [noise=true , address=145.79.227.29:4955   , piece_id=CBV7RUAZ6QAZE3VDTZKOGTIMOY66VUJTSYQSZRC7WLUD53UWVJTQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.347028050 (591h37m2.218111095s) [noise=true , address=145.79.227.34:4931   , piece_id=TJ4NTHHJQ4VLPBIC7RW42DBFIBI5G7LJWBN53TPSEVAWHANHMTBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.427966770 (591h37m2.299049815s) [noise=true , address=145.79.227.5:4226    , piece_id=QKDFEH6UKIH4QYN6DE3YNH3FZPAYGNYMQSBCYGM7EAW7F4MDA66A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.446440007 (591h37m2.317523052s) [noise=true , address=145.79.227.35:4494   , piece_id=U4P6QB4ZRFGAJOHVSSTZHCG4PTBGII4LXAAJXXVN5RVR4WUWUBBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.583477598 (591h37m2.454560643s) [noise=true , address=77.90.31.19:4859     , piece_id=XHNZMPC2MF4RALF2FZJY73UYN4XWOYJUL66RFRUXNPT64JZQE5KQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.613112418 (591h37m2.484195463s) [noise=true , address=77.90.31.17:4781     , piece_id=TFUDJVQZFLS2XTZEGBPTV23WYLNHZMGK5ZXNDJSMW5HSNZXWXBBA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.631421591 (591h37m2.502504626s) [noise=true , address=77.90.31.10:4530     , piece_id=LNRM5YW2MZLXHWHGNUMP5I7Y5RRNRESBUA2M3SQKDFEQXZ25RJ3A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:02.944663583 (591h37m2.815746628s) [noise=true , address=145.79.227.49:4365   , piece_id=Z357V6BZEGQOFLFH32RQLYJJZDLURVHZAHKW3H3ZIJXMQC3ZIFBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.195837408 (591h37m3.066920453s) [noise=true , address=193.149.164.143:4704 , piece_id=PQQZ6N4A7TZGGX5DVRE6NT6TSDJVQARR22F6MZ5Z6LYXLUKF4V7A, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.269365478 (591h37m3.140448523s) [noise=true , address=145.79.227.44:4221   , piece_id=GDKGEN3QCGFIICNST42FA2ZLLTQCHL2QAZ7AMUNPJIGYTSHDMOJQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.272362485 (591h37m3.14344553s) [noise=true , address=145.79.227.30:4778   , piece_id=EVWGEZL3VCMHEM6ALESBLMU65XBE74CKVMFXMSHK2GCXFPI35RBQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340891504 (591h37m3.211974549s) [noise=true , address=145.79.227.40:4082   , piece_id=7UFAIMVNINXXXRPNXLGJ34YEO3ILVN2O7UFG3HHTIT2DKWVZSUPA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: <nil>
Dec 30 07:06:03.340922954 (591h37m3.212005999s) [seg_pos={0 0}, upload=518641]: Segment reached optimal threshold of 14 pieces.
Dec 30 07:06:03.341286095 (591h37m3.21236913s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey): protocol: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47364->77.90.31.14:4693: use of closed network connection
Dec 30 07:06:03.341317094 (591h37m3.212400139s) [noise=true , address=77.90.31.14:4693     , piece_id=CQ6A6DJJDCKQAAMCXW7FELWCWKAOI7YCCWKVDSTZEBXNHVKQRKPQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341322114 (591h37m3.212405159s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF
Dec 30 07:06:03.341336261 (591h37m3.212419306s) [noise=true , address=145.79.227.33:4901   , piece_id=FFTUVNIKVKRAZ5R44V6WLWNKKC5MQYA66RZPSMW6N5EQKY7NSGZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341546141 (591h37m3.212629196s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5): protocol: expected piece hash; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; write tcp 188.166.225.170:51728->45.91.116.4:4963: use of closed network connection; EOF
Dec 30 07:06:03.341555549 (591h37m3.212638594s) [noise=true , address=45.91.116.4:4963     , piece_id=FUGWNAY33ZGP6J57FIODDQQJ2UH46ABT52AU4Y7Y74Q2AOTCXWFA, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341759577 (591h37m3.212842622s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42002->64.49.13.169:4713: use of closed network connection
Dec 30 07:06:03.341769897 (591h37m3.212852942s) [noise=true , address=64.49.13.169:4713    , piece_id=YS6FRVS5V3BECH3TJQRJBGB5SSYYGUBK2HMO25PZEUOUSC7ENNZQ, seg_pos={0 0}, upload=518641]: Long tail cancellation due to optimal threshold
Dec 30 07:06:03.341869927 (591h37m3.212952972s) [seg_pos={0 0}, upload=518641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 07:06:03.342018730 (591h37m3.213101775s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:06:03.342025634 (591h37m3.213108679s) [upload=518641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:06:03.635315934 (591h37m3.506398979s) [upload=518641]: Done uploading segments...
Dec 30 07:06:03.635343146 (591h37m3.506426191s) [upload=518641]: Upload finished. err: <nil>
Duration: 39.604970019s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
15 out of 60 is failed (threshold=3) [X.....X.......X.X.....X....XX...X.....X....XXX..X.....X...X.]
duration: 
6.018022926s
trace: 
https://jaeger.dev.storj.io/trace/8eeb125f896a5b3
FAIL (2025-12-30 07:08:11 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
764191 (591h38m12.297847226s) [upload=518661]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 07:07:12.675629259 (591h38m12.546712324s) [seg_pos={0 0}, upload=518661]: Begin upload segment...
Dec 30 07:07:12.675694573 (591h38m12.546777618s) [seg_pos={0 0}, upload=518661]: Done begin upload segment.
Dec 30 07:07:12.675737895 (591h38m12.546820931s) [noise=true , address=145.79.227.39:4015   , piece_id=P7HH7EHEMMLVHOMIZAEUWYVTY5OTYRBOZ7CKZGA75625ZBBKQHVQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.675762292 (591h38m12.546845327s) [noise=true , address=145.79.227.16:4910   , piece_id=2ZWZ4NNDX5SAYTQ6L42PMTZGFQEAN57T5B2M3ZOP5ROA4QNY777Q, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.676382714 (591h38m12.547465759s) [noise=true , address=45.91.116.6:4975     , piece_id=MLO5RXEGU4GDRHOX2QJQM44N6YT7MPADPX2JQDXWMEY7L7T33WDA, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.676788356 (591h38m12.547871401s) [noise=true , address=145.79.227.14:4838   , piece_id=LN6KEVKJG6LFVEJMWFGELDIRDW2HBQRVCTYVFEFR7QHHQW6J22GA, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.677147680 (591h38m12.548230725s) [noise=true , address=145.79.227.17:4970   , piece_id=4KYAMRP5B5ZKURR7NW42KM2VY6OZ47ALVAJ6TFKBNIGBLJMVONUQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.677593188 (591h38m12.548676233s) [noise=true , address=45.91.116.11:4120    , piece_id=HD3KJHF7QSDP3X6JSIUFLPRGIJ275HHNDH6AXXAP7ATDQZHIQTDQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.678062893 (591h38m12.549145928s) [noise=true , address=145.79.227.19:4077   , piece_id=WEPMAELFUB5XHMNXF2TTN6ZJBHX2MUFTNVMXINRUYNILHZFZQ7TQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.678663566 (591h38m12.549746611s) [noise=true , address=77.90.31.16:4735     , piece_id=BLFBKMN6L26IMBFFG6JQX66ZIT2Z7B6GSMUIGRKR4UHR5N6RE53A, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.679086572 (591h38m12.550169617s) [noise=true , address=145.79.227.21:4475   , piece_id=63J2HFZKGWVEAQ7IJSXQDEYVS7LJJBY2RHSQPF6URCQTUYDPB26A, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.680368603 (591h38m12.551451638s) [noise=true , address=77.90.31.18:4808     , piece_id=CZA4RFW5LJ67AP6OZ5IXS7OKKXOI5OOQIW4XJMI6ZURLGJY6FVUA, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.681778929 (591h38m12.552861974s) [noise=true , address=145.79.227.9:4367    , piece_id=PVD66U2AS32VFSOXCP5MLPZEWK6GJJROHMN77MHWZZNXF7QOLR3Q, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.683688956 (591h38m12.554772001s) [noise=true , address=145.79.227.32:4834   , piece_id=MUAW3TTEC2MCOZPUUPSOY72HO4FIERJ7H5V3SSZFNANDHYFNOFRA, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.685982012 (591h38m12.557065057s) [noise=true , address=145.79.227.11:4730   , piece_id=7NKP2QYTVX5R6AR2X5ZMOXXAKMXUVEVIA3WCXOXAG6IRYU6ICG3Q, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.689043131 (591h38m12.560126166s) [noise=true , address=145.79.227.2:4115    , piece_id=FGULHLCRG36PVSVB6SGGKYDV4CISURBU6PFEHXFMF2RAI4UMRWFQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.692211624 (591h38m12.563294669s) [noise=true , address=145.79.227.48:4302   , piece_id=KI3F3YOC3SQFMN4NUOIJLI7PHWUCRE66MDOSPJ5IRTYIN5CH752Q, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:12.692822517 (591h38m12.563905552s) [noise=true , address=77.90.31.11:4555     , piece_id=RHUEJHWRHKQIPE6QDZHIK7EQH6NPOZUY4N4WJOUHPICQYIXVTZBQ, seg_pos={0 0}, upload=518661]: Uploading piece...
Dec 30 07:07:14.379433447 (591h38m14.250516492s) [upload=518661]: Next returned nil segment
Dec 30 07:07:14.379460639 (591h38m14.250543674s) [upload=518661]: Waiting for error group managing segments...
Dec 30 07:07:14.652296722 (591h38m14.523379767s) [noise=true , address=145.79.227.21:4475   , piece_id=63J2HFZKGWVEAQ7IJSXQDEYVS7LJJBY2RHSQPF6URCQTUYDPB26A, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.665685326 (591h38m14.536768361s) [noise=true , address=145.79.227.14:4838   , piece_id=LN6KEVKJG6LFVEJMWFGELDIRDW2HBQRVCTYVFEFR7QHHQW6J22GA, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.671157856 (591h38m14.542240891s) [noise=true , address=145.79.227.39:4015   , piece_id=P7HH7EHEMMLVHOMIZAEUWYVTY5OTYRBOZ7CKZGA75625ZBBKQHVQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.680810998 (591h38m14.551894043s) [noise=true , address=145.79.227.9:4367    , piece_id=PVD66U2AS32VFSOXCP5MLPZEWK6GJJROHMN77MHWZZNXF7QOLR3Q, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.684231100 (591h38m14.555314145s) [noise=true , address=145.79.227.11:4730   , piece_id=7NKP2QYTVX5R6AR2X5ZMOXXAKMXUVEVIA3WCXOXAG6IRYU6ICG3Q, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.684872801 (591h38m14.555955846s) [noise=true , address=145.79.227.32:4834   , piece_id=MUAW3TTEC2MCOZPUUPSOY72HO4FIERJ7H5V3SSZFNANDHYFNOFRA, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.697728480 (591h38m14.568811525s) [noise=true , address=145.79.227.48:4302   , piece_id=KI3F3YOC3SQFMN4NUOIJLI7PHWUCRE66MDOSPJ5IRTYIN5CH752Q, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.697931317 (591h38m14.569014352s) [noise=true , address=145.79.227.19:4077   , piece_id=WEPMAELFUB5XHMNXF2TTN6ZJBHX2MUFTNVMXINRUYNILHZFZQ7TQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.700481092 (591h38m14.571564137s) [noise=true , address=145.79.227.16:4910   , piece_id=2ZWZ4NNDX5SAYTQ6L42PMTZGFQEAN57T5B2M3ZOP5ROA4QNY777Q, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.750214011 (591h38m14.621297066s) [noise=true , address=145.79.227.2:4115    , piece_id=FGULHLCRG36PVSVB6SGGKYDV4CISURBU6PFEHXFMF2RAI4UMRWFQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.752413710 (591h38m14.623496755s) [noise=true , address=145.79.227.17:4970   , piece_id=4KYAMRP5B5ZKURR7NW42KM2VY6OZ47ALVAJ6TFKBNIGBLJMVONUQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.854173517 (591h38m14.725256552s) [noise=true , address=77.90.31.16:4735     , piece_id=BLFBKMN6L26IMBFFG6JQX66ZIT2Z7B6GSMUIGRKR4UHR5N6RE53A, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.893691125 (591h38m14.76477417s) [noise=true , address=77.90.31.18:4808     , piece_id=CZA4RFW5LJ67AP6OZ5IXS7OKKXOI5OOQIW4XJMI6ZURLGJY6FVUA, seg_pos={0 0}, upload=518661]: Done uploading piece. err: <nil>
Dec 30 07:07:14.893713817 (591h38m14.764796852s) [seg_pos={0 0}, upload=518661]: Segment reached optimal threshold of 13 pieces.
Dec 30 07:07:14.893949216 (591h38m14.765032261s) [noise=true , address=77.90.31.11:4555     , piece_id=RHUEJHWRHKQIPE6QDZHIK7EQH6NPOZUY4N4WJOUHPICQYIXVTZBQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ): protocol: write tcp 188.166.225.170:37822->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:37822->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37822->77.90.31.11:4555: use of closed network connection
Dec 30 07:07:14.893956369 (591h38m14.765039404s) [noise=true , address=77.90.31.11:4555     , piece_id=RHUEJHWRHKQIPE6QDZHIK7EQH6NPOZUY4N4WJOUHPICQYIXVTZBQ, seg_pos={0 0}, upload=518661]: Long tail cancellation due to optimal threshold
Dec 30 07:07:14.894019309 (591h38m14.765102344s) [noise=true , address=45.91.116.6:4975     , piece_id=MLO5RXEGU4GDRHOX2QJQM44N6YT7MPADPX2JQDXWMEY7L7T33WDA, seg_pos={0 0}, upload=518661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: write tcp 188.166.225.170:51554->45.91.116.6:4975: use of closed network connection; write tcp 188.166.225.170:51554->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->45.91.116.6:4975: use of closed network connection
Dec 30 07:07:14.894034879 (591h38m14.765117914s) [noise=true , address=45.91.116.6:4975     , piece_id=MLO5RXEGU4GDRHOX2QJQM44N6YT7MPADPX2JQDXWMEY7L7T33WDA, seg_pos={0 0}, upload=518661]: Long tail cancellation due to optimal threshold
Dec 30 07:07:14.894067161 (591h38m14.765150206s) [noise=true , address=45.91.116.11:4120    , piece_id=HD3KJHF7QSDP3X6JSIUFLPRGIJ275HHNDH6AXXAP7ATDQZHIQTDQ, seg_pos={0 0}, upload=518661]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: write tcp 188.166.225.170:36546->45.91.116.11:4120: use of closed network connection; write tcp 188.166.225.170:36546->45.91.116.11:4120: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36546->45.91.116.11:4120: use of closed network connection
Dec 30 07:07:14.894073563 (591h38m14.765156608s) [noise=true , address=45.91.116.11:4120    , piece_id=HD3KJHF7QSDP3X6JSIUFLPRGIJ275HHNDH6AXXAP7ATDQZHIQTDQ, seg_pos={0 0}, upload=518661]: Long tail cancellation due to optimal threshold
Dec 30 07:07:14.894168092 (591h38m14.765251127s) [seg_pos={0 0}, upload=518661]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 07:07:14.894329470 (591h38m14.765412505s) [upload=518661]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 07:07:14.894334960 (591h38m14.765418005s) [upload=518661]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 07:07:15.192917548 (591h38m15.064000583s) [upload=518661]: Done uploading segments...
Dec 30 07:07:15.192936164 (591h38m15.064019199s) [upload=518661]: Upload finished. err: <nil>
Duration: 6.018052693s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
1 out of 60 is failed (threshold=3) [........................X...................................]
duration: 
6.552453526s
trace: 
https://jaeger.dev.storj.io/trace/4c2f4efaff0e0ea0
FAIL (2025-12-30 07:08:05 UTC) 
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
load=518292]: Uploading piece...
Dec 30 06:41:13.598100152 (591h12m13.469183187s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.598587971 (591h12m13.469671016s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599093143 (591h12m13.470176178s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.599699999 (591h12m13.470783034s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600136169 (591h12m13.471219204s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.600543184 (591h12m13.471626229s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601048286 (591h12m13.472131332s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.601698784 (591h12m13.472781819s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602168259 (591h12m13.473251304s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:13.602782708 (591h12m13.473865753s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Uploading piece...
Dec 30 06:41:14.423395002 (591h12m14.294478047s) [upload=518292]: Next returned nil segment
Dec 30 06:41:14.423414068 (591h12m14.294497103s) [upload=518292]: Waiting for error group managing segments...
Dec 30 06:41:14.817650316 (591h12m14.688733351s) [noise=true , address=185.167.204.205:4029 , piece_id=KUOMMYJ2F4NIK6VN4C5M3Y3TMHYEZH7QFNJ6K3CLOAVI5R6VKTHQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.817870054 (591h12m14.688953099s) [noise=true , address=185.167.204.205:4019 , piece_id=H6AH654VGX6NHBUKODIWGL7I2RKE3DDMY4UM6VDONP2EP3NPDJBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818623698 (591h12m14.689706744s) [noise=true , address=185.167.204.206:4065 , piece_id=LD3J4656Q5QEUCMJ5OKEYATEVRIKSXO7XGARTN25BVM7FDIYOWKA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.818932436 (591h12m14.690015481s) [noise=true , address=185.167.204.206:4061 , piece_id=T2XS4IFPQSVS3T45SPQ5ZDDVT2VMTMXHKL2ZMX4OIOPRR67SCD2Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819147046 (591h12m14.690230091s) [noise=true , address=185.167.204.206:4071 , piece_id=QI2TOY5KCDZVWCCLMAJXVUWD2HB7S7IOTEAV2EHAMUNHKOFKTNYA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819678578 (591h12m14.690761623s) [noise=true , address=185.167.204.206:4059 , piece_id=LMOGTWX2YIRR3EKNROK43O2B27S5L5U6GYB7HBVRBPQPH4WDDWZQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.819905028 (591h12m14.690988063s) [noise=true , address=185.167.204.206:4058 , piece_id=ROOCGK64M5RHIWNAVCSZNYTZ6M2ORWB7MJ27XJVDTFVQIKJZHY4A, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.820479312 (591h12m14.691562357s) [noise=true , address=185.167.204.205:4021 , piece_id=KP7J5XSY4SKSKZG7XXFZMNKMRP4472PXI7CW2UQBZICN4MAFO5RQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.823149296 (591h12m14.694232331s) [noise=true , address=185.167.204.205:4034 , piece_id=OWZHQB5ZDT2QZ2QAHZJVRWQ222MX6CWLKJUOIAAGSMAVLWGJAOBA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.827906996 (591h12m14.698990041s) [noise=true , address=185.167.204.206:4055 , piece_id=VYEDR6XHZBZMTVJ5U5OF67WZOGVMCMQLXXBQUI7DHBCCVQ2RRERQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828003769 (591h12m14.699086814s) [noise=true , address=185.167.204.205:4016 , piece_id=I6MUDLAXUUDJL2C4HFE22C2L56A7D6HSCNWXKWJ7OKO2N4RA4W7Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.828893203 (591h12m14.699976238s) [noise=true , address=185.167.204.206:4064 , piece_id=H4PP7HPHXRX2LOZ4776AMWAJDN7OC435E2K4BXI7XOZYKTB4YUNA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829477074 (591h12m14.700560109s) [noise=true , address=185.167.204.205:4017 , piece_id=CZP65KETMGOHFDMV7KENRL4V36UHBPWRDCBBPUM5NE5L2PV4AQCQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.829774972 (591h12m14.700858007s) [noise=true , address=185.167.204.206:4043 , piece_id=G7VZYID4TXGNPDN63NQULXOVSX42WMFFNPBX6KQJ5L2WSW4D2YGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:14.831734493 (591h12m14.702817528s) [noise=true , address=185.167.204.206:4049 , piece_id=BQ7JEGSGPIFJUGZFBYRPDMBNPZ24BG6TEG4VUM4JUBTE4T2RF4SA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.405688561 (591h12m15.276771606s) [noise=true , address=81.171.14.70:4027    , piece_id=6WEORWX5QOMFSJUEADIIBHHIPKNFP4NJPZAJADBUTPUSG7MZJMOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.417110440 (591h12m15.288193485s) [noise=true , address=81.171.14.70:4031    , piece_id=U6Z4SNK32ZSWQ7NDR7ACXGRC4BADDOPR65ILBR64QLGVNDBADFFQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.425600446 (591h12m15.296683481s) [noise=true , address=81.171.14.70:4037    , piece_id=6A25LEIAQEJB3DNCTXQT6K7ZSKIGOW4QUGMNKLOG3CT2XXH25PSA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.499056228 (591h12m15.370139263s) [noise=true , address=81.171.14.70:4038    , piece_id=3WRHW3VGXWHOEOV5Q6CLYSF7MUVWS7QHTNHLSTCKAUERPHAH3I3Q, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.514998925 (591h12m15.38608197s) [noise=true , address=81.171.14.70:4041    , piece_id=NORNA6WFTGPNOHU7MPTNNB5ONTBS5DJGCN2NWIZAEPYSUSIOSGEQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528579544 (591h12m15.399662589s) [noise=true , address=81.171.14.70:4030    , piece_id=KITOJIT34CHS2QZBXCW2SJPZB4RHEHCMJ6IYQ4Z5KLL24YAWBIUQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.528991398 (591h12m15.400074434s) [noise=true , address=81.171.14.70:4047    , piece_id=ZWV5DP4YC3MSYDWEQH4ZK3VR4WZ4DUTI4VL3WVLQKFIEKIW44LOQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.534844544 (591h12m15.405927579s) [noise=true , address=81.171.14.70:4035    , piece_id=XCLL5SOAPJSSGF5YYQH6ZKGOHMLS6RI6H26FOW5XIJRY3TWYNEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.915614910 (591h12m15.786697945s) [noise=true , address=81.171.14.70:4039    , piece_id=DEJDXFDHOSAMIP2FN5LJBJNBB4QLJSE2AUDW6IMA6IC4VRY7VAGQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:15.967820176 (591h12m15.838903211s) [noise=true , address=81.171.14.70:4046    , piece_id=B2MTUNKMUP5S7XW4SVQ5QI2ZO3VFB5QVAKBBY4BIZIUILM6O7VYQ, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172116128 (591h12m16.043199163s) [noise=true , address=89.149.201.147:4007  , piece_id=HZLSYGSBP4TJH5V5XF3Q3AETJU625ERNDBD3VXW2HUZTTPAHLBMA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: <nil>
Dec 30 06:41:16.172137559 (591h12m16.043220604s) [seg_pos={0 0}, upload=518292]: Segment reached optimal threshold of 26 pieces.
Dec 30 06:41:16.172336949 (591h12m16.043419994s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172344213 (591h12m16.043427258s) [noise=true , address=89.149.201.147:4008  , piece_id=XYFRNJVIFFZA5S36KFPGZPVCPLRL2OW5QBJD3UR37VPPA2RX3RJA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172554002 (591h12m16.043637037s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic): protocol: expected piece hash; context canceled; EOF
Dec 30 06:41:16.172565233 (591h12m16.043648278s) [noise=true , address=89.149.201.147:4020  , piece_id=N7G5DGEDYVKBTO5S6BYW3IYEOK7HAMK5JQIBMVPMPYRDHXODWEGA, seg_pos={0 0}, upload=518292]: Long tail cancellation due to optimal threshold
Dec 30 06:41:16.172587506 (591h12m16.043670541s) [seg_pos={0 0}, upload=518292]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 30 06:41:16.172717945 (591h12m16.04380098s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:41:16.172724567 (591h12m16.043807602s) [upload=518292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:41:16.404092237 (591h12m16.275175292s) [upload=518292]: Done uploading segments...
Dec 30 06:41:16.404119940 (591h12m16.275202975s) [upload=518292]: Upload finished. err: <nil>
Duration: 6.552484645s core uplink eu-select-1 eu1-placement-15