Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
29 out of 60 is failed (threshold=3) [.XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.XXX.X.XXX.X] duration:
1m0.003209682s
FAIL (2025-08-26 14:22:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
ing piece...
Aug 26 14:21:40.288607840 (22h18m7.447373574s) [noise=true , address=185.167.204.205:4036 , piece_id=U4J7LQ4JFZVS3KZFXMRHY5LR5VKZ42UIVBVMR2Z2CZWXKX4WFV3Q, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.288849592 (22h18m7.447615326s) [noise=true , address=81.171.14.70:4035 , piece_id=II45WRFKFUS7A5MNEV5KEYTFD7JHJ6PH3UE26Q6YH5UDOPKIL5WQ, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.289113798 (22h18m7.447879532s) [noise=true , address=89.149.201.147:4017 , piece_id=ZYZE6LYJYRZWTK53AFTU6ZNCR4JK7TG62L3MI7TSDBBE6ZAQWRKA, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.289414583 (22h18m7.448180317s) [noise=true , address=185.167.204.206:4055 , piece_id=K4ZMUO546A4PINTVRNFFOYTJNNLMUOBF52WVDTRFD6ZYJ5UOPPBA, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.289680082 (22h18m7.448445816s) [noise=true , address=81.171.14.70:4026 , piece_id=5LQPMIWE72UROX4RDUOIEWFFRVN577KGGZ7AQB7PET73GUPC5IUQ, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.289931573 (22h18m7.448697307s) [noise=true , address=185.167.204.205:4017 , piece_id=IE5R5LYJB6UEVVJ32ZXVTVG6URNZU6L6ZTAPNUCOD55NEGSBTTQA, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.290159909 (22h18m7.448925633s) [noise=true , address=89.149.201.147:4014 , piece_id=TIKRNDH5COZYORCIYKPBW6UHT75X7D6K6WWLGZLEAZG7WFYAZFJA, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.290376694 (22h18m7.449142428s) [noise=true , address=185.167.204.206:4057 , piece_id=U6DDKLJMAPCSUXBR6YJBVCBITRWIXD2YHYLVXA4NH7MFI3UYQLMA, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.290590093 (22h18m7.449355827s) [noise=true , address=185.167.204.206:4039 , piece_id=QTUOQVBYITOHFSEFX5SGI6LX57QY2HU26EKWBQ7CQIFWI64VZCTA, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.290805305 (22h18m7.449571039s) [noise=true , address=185.167.204.206:4062 , piece_id=52NO2NBR4JFFDZU4DKAF7NRC5NHHXCPTQFF4KVDAWCMGHKIJDENA, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.291018503 (22h18m7.449784237s) [noise=true , address=81.171.14.70:4046 , piece_id=LR3KLP2QZBPJO2Q4FHQKCSBUACZAN74Q5XLIBEZKEA355UZR7VCA, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.291247511 (22h18m7.450013245s) [noise=true , address=89.149.201.147:4006 , piece_id=GQAVX3FSDTJCL627S3X6L6VLIAXA5ALEG6TLR4XHWEYSA6SFCVLA, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:40.291465848 (22h18m7.450231582s) [noise=true , address=185.167.204.205:4014 , piece_id=URXB5IQXDU2MWUJNG7RFAHY4RBXETAANHYRWGY4X67XKOZVROCCQ, seg_pos={0 0}, upload=19487]: Uploading piece...
Aug 26 14:21:41.128524360 (22h18m8.287290094s) [upload=19487]: Next returned nil segment
Aug 26 14:21:41.128545259 (22h18m8.287310994s) [upload=19487]: Waiting for error group managing segments...
Aug 26 14:21:41.530994350 (22h18m8.689760084s) [noise=true , address=81.171.14.70:4025 , piece_id=FHUNKLD2BJUW3KSADQLLF55T7A4TZSPRSYKGLCHAUWRKULTYJXWQ, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.533189660 (22h18m8.691955394s) [noise=true , address=81.171.14.70:4046 , piece_id=LR3KLP2QZBPJO2Q4FHQKCSBUACZAN74Q5XLIBEZKEA355UZR7VCA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.537761900 (22h18m8.696527634s) [noise=true , address=81.171.14.70:4041 , piece_id=7LM7QYKYRSY2EKB7MQK7TO245Q25NN6RZ7FRAVHYLAY7VSHG6TBQ, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.538402195 (22h18m8.697167919s) [noise=true , address=81.171.14.70:4026 , piece_id=5LQPMIWE72UROX4RDUOIEWFFRVN577KGGZ7AQB7PET73GUPC5IUQ, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.561161878 (22h18m8.719927612s) [noise=true , address=81.171.14.70:4031 , piece_id=HVOA2EFOKSMIODFLKEGPPXEV4YISACWMD76OIHINSMAFV4ZADI3A, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.569668074 (22h18m8.728433809s) [noise=true , address=89.149.201.147:4009 , piece_id=2AAVYP22PGZFF2NJ67YJD7S7PUMFHWGHR52RARHHHWNDY3NVUW7A, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.573988713 (22h18m8.732754447s) [noise=true , address=89.149.201.147:4014 , piece_id=TIKRNDH5COZYORCIYKPBW6UHT75X7D6K6WWLGZLEAZG7WFYAZFJA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.589396336 (22h18m8.74816207s) [noise=true , address=81.171.14.70:4035 , piece_id=II45WRFKFUS7A5MNEV5KEYTFD7JHJ6PH3UE26Q6YH5UDOPKIL5WQ, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.590217628 (22h18m8.748983362s) [noise=true , address=89.149.201.147:4018 , piece_id=PYDX76CWWD2I7WJ5MQDIBHH3A7SKCCQ27DWAYRN6TXOOSFUZGQMQ, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.592649582 (22h18m8.751415316s) [noise=true , address=89.149.201.147:4011 , piece_id=TFQX35EMSCEG5QL5OHM3WP3DHHSFMI253CQLDCS2FZGUZTCJQQKQ, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.611365406 (22h18m8.770131141s) [noise=true , address=89.149.201.147:4006 , piece_id=GQAVX3FSDTJCL627S3X6L6VLIAXA5ALEG6TLR4XHWEYSA6SFCVLA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:41.618997891 (22h18m8.777763625s) [noise=true , address=89.149.201.147:4024 , piece_id=52JSZJI4XFIFOVV4W255U2LWTFD6WT3Y6TG5OIFKU2DC4FPNQIIQ, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:42.073677949 (22h18m9.232443683s) [noise=true , address=89.149.201.147:4017 , piece_id=ZYZE6LYJYRZWTK53AFTU6ZNCR4JK7TG62L3MI7TSDBBE6ZAQWRKA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:42.092445042 (22h18m9.251210776s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNOWF7KIWWJDLC2SV7N234JXGM5PRW36YAVCWJZ3PSHDI6VQYUA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:42.093037886 (22h18m9.25180362s) [noise=true , address=81.171.14.70:4042 , piece_id=UBMHAU4Y33B2L3MEVNQQBR5WFQU7DGNSXQEL5P6IO6HLGZLCWBJQ, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:42.117173090 (22h18m9.275938825s) [noise=true , address=89.149.201.147:4012 , piece_id=YOTUKFXTKWMOYIXJP6CDCFK75GPG2VUYGDQCKI3JJGIM5O3VJLWA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:43.018435591 (22h18m10.177201325s) [noise=true , address=185.167.204.205:4002 , piece_id=TS2GWMLPC4MTY6IIRD223RRHIUMIBRIH5JUTOMTHTYDXEHNNTW2A, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:43.034406623 (22h18m10.193172357s) [noise=true , address=185.167.204.206:4049 , piece_id=CGPALB55QKCO6DE26TEXJP4A6KIMTUVUPOJLHQLUHP5DXATGBCPA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:43.040014674 (22h18m10.198780398s) [noise=true , address=185.167.204.206:4039 , piece_id=QTUOQVBYITOHFSEFX5SGI6LX57QY2HU26EKWBQ7CQIFWI64VZCTA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:43.056267617 (22h18m10.215033351s) [noise=true , address=185.167.204.205:4014 , piece_id=URXB5IQXDU2MWUJNG7RFAHY4RBXETAANHYRWGY4X67XKOZVROCCQ, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:43.079465147 (22h18m10.238230881s) [noise=true , address=185.167.204.206:4058 , piece_id=YIDEDZ3YTRAADRNL6PDXEKOPT7FDVMOLLD26U356Z4THSM2LW7FA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:43.116144496 (22h18m10.27491023s) [noise=true , address=185.167.204.206:4062 , piece_id=52NO2NBR4JFFDZU4DKAF7NRC5NHHXCPTQFF4KVDAWCMGHKIJDENA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:43.151500982 (22h18m10.310266706s) [noise=true , address=185.167.204.206:4055 , piece_id=K4ZMUO546A4PINTVRNFFOYTJNNLMUOBF52WVDTRFD6ZYJ5UOPPBA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:45.078555662 (22h18m12.237321396s) [noise=true , address=185.167.204.205:4017 , piece_id=IE5R5LYJB6UEVVJ32ZXVTVG6URNZU6L6ZTAPNUCOD55NEGSBTTQA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:46.248585781 (22h18m13.407351505s) [noise=true , address=185.167.204.206:4057 , piece_id=U6DDKLJMAPCSUXBR6YJBVCBITRWIXD2YHYLVXA4NH7MFI3UYQLMA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:47.546968724 (22h18m14.705734448s) [noise=true , address=185.167.204.206:4037 , piece_id=LKCG5TMA6XVPU3E27UTEWNMJOHUF3MQ6SNGVXKENWFMUCJZWFMNA, seg_pos={0 0}, upload=19487]: Done uploading piece. err: <nil>
Aug 26 14:21:47.546996748 (22h18m14.705762492s) [seg_pos={0 0}, upload=19487]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:21:47.547112108 (22h18m14.705877842s) [noise=true , address=185.167.204.206:4054 , piece_id=RLEZJWOVINNBDEUXUGAYQU5NKH37X7LCKNCTXDDZYYWEB575VUTQ, seg_pos={0 0}, upload=19487]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u): protocol: expected piece hash; context canceled; EOF
Aug 26 14:21:47.547161673 (22h18m14.705927407s) [noise=true , address=185.167.204.205:4036 , piece_id=U4J7LQ4JFZVS3KZFXMRHY5LR5VKZ42UIVBVMR2Z2CZWXKX4WFV3Q, seg_pos={0 0}, upload=19487]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV): protocol: expected piece hash; context canceled; EOF
Aug 26 14:21:47.547180500 (22h18m14.705946234s) [seg_pos={0 0}, upload=19487]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:21:47.547244161 (22h18m14.706009885s) [upload=19487]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:21:47.547248199 (22h18m14.706013933s) [upload=19487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:21:47.799628168 (22h18m14.958393892s) [upload=19487]: Done uploading segments...
Aug 26 14:21:47.799644760 (22h18m14.958410485s) [upload=19487]: Upload finished. err: <nil>
Duration: 1m0.003231044s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
28 out of 60 is failed (threshold=3) [..XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.XXX.X.XXX.] duration:
39.275019234s
FAIL (2025-08-26 14:21:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
IOQHRFR5WDOUSA6K5AACNFMSLFFYXBF2IZ4QOYTQ, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.630152989 (22h15m54.788918713s) [noise=true , address=81.171.14.70:4026 , piece_id=AVEGP3TUJZQIYSIWHOWJDA4DQ4ERT7BF2P6REETU4SODCKJ5NSBA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.630417465 (22h15m54.789183199s) [noise=true , address=185.167.204.206:4068 , piece_id=4GUQCDVFRGUJLRG7SANEL53BNI7Z4KIOGPBVMKFQV4U4Y2EEM3ZA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.630680758 (22h15m54.789446492s) [noise=true , address=185.167.204.206:4069 , piece_id=ORC4DFNAWKPULKIOANUP6NL52GL6B4E5VX5ZTRC5MNAZCPR4XRSQ, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.630726506 (22h15m54.78949224s) [noise=true , address=185.167.204.206:4040 , piece_id=3745FYPS3Y5VEYNN4Z3SUXXDCLC4UB3KLEDM5E2IJUATKFKU2QTQ, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.631015388 (22h15m54.789781112s) [noise=true , address=89.149.201.147:4005 , piece_id=EZVRZF5HSYGYLA47S2THDO65CMP5IVYWW66WJYR7ADUPGDRJJ6VA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.631070133 (22h15m54.789835867s) [noise=true , address=89.149.201.147:4020 , piece_id=UUJX36AMEFLBTEAZPARWPSHDLY6CVQMEETGVETVYTC23TFTCXNKA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.631311806 (22h15m54.79007754s) [noise=true , address=185.167.204.205:4008 , piece_id=UY2ZD2KVKHB6P5BCRJ6ZE6FWHJAUTEBA2AW2I7ZSTPBZILT2MBFQ, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.631594097 (22h15m54.790359821s) [noise=true , address=185.167.204.205:4035 , piece_id=RQX5ZAR5PCXKVYZEKLR4NZAI273IWSRB45KHUV47YHKJ4VLWJDRA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.631613693 (22h15m54.790379427s) [noise=true , address=81.171.14.70:4042 , piece_id=S4LF2LKN7DWHNT4LQ53UULSG3JZADPA3LBRUE267CMOXY2OJAHIA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.632043065 (22h15m54.790808799s) [noise=true , address=81.171.14.70:4046 , piece_id=HVJWVAUDDFAIGJ4L2YXUKLSS25SAQTOIVWS32AVDUNE6LITNB6AA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.634809789 (22h15m54.793575523s) [noise=true , address=89.149.201.147:4009 , piece_id=JKWPVNAT7SJRSH4C7UF3ZF73ZRKMIVFAN6V2SCKASK4EY5UXRXAQ, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.635896699 (22h15m54.794662433s) [noise=true , address=185.167.204.206:4053 , piece_id=BVF3XLQOVYSQYFRLHCAZLHVYMFI2SSDTCZFXK5PF2IG2BJPOP64A, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:28.459451849 (22h15m55.618217583s) [upload=19456]: Next returned nil segment
Aug 26 14:19:28.459472579 (22h15m55.618238313s) [upload=19456]: Waiting for error group managing segments...
Aug 26 14:19:28.837923547 (22h15m55.996689281s) [noise=true , address=81.171.14.70:4034 , piece_id=GSM5NSP7F4FVCHS7G4LKRK7L2VJOIHHAKOH6CDNMJA7IPWUFOLMA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.860181559 (22h15m56.018947283s) [noise=true , address=81.171.14.70:4042 , piece_id=S4LF2LKN7DWHNT4LQ53UULSG3JZADPA3LBRUE267CMOXY2OJAHIA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.864545660 (22h15m56.023311384s) [noise=true , address=81.171.14.70:4026 , piece_id=AVEGP3TUJZQIYSIWHOWJDA4DQ4ERT7BF2P6REETU4SODCKJ5NSBA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.869161202 (22h15m56.027926936s) [noise=true , address=81.171.14.70:4039 , piece_id=MZEG7T3HVSHIGDIR3IGMIGKYKJA7GWG5DWQJHBRINY47SW22NH3Q, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.879827523 (22h15m56.038593257s) [noise=true , address=81.171.14.70:4046 , piece_id=HVJWVAUDDFAIGJ4L2YXUKLSS25SAQTOIVWS32AVDUNE6LITNB6AA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.886473872 (22h15m56.045239596s) [noise=true , address=81.171.14.70:4027 , piece_id=NXWJ5SDPDWE2JVSTMQKVNJRUEEC5DRVR335W3I5EU2TLR3CNVGHQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.895312926 (22h15m56.05407865s) [noise=true , address=81.171.14.70:4038 , piece_id=43M5LZ2PXSHHL7CH2W347TLA46TCHW3DCBPCJTAHUU3RB27H25UA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.895514011 (22h15m56.054279745s) [noise=true , address=89.149.201.147:4005 , piece_id=EZVRZF5HSYGYLA47S2THDO65CMP5IVYWW66WJYR7ADUPGDRJJ6VA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.908547592 (22h15m56.067313316s) [noise=true , address=89.149.201.147:4013 , piece_id=5IBITZI2FANP2DFK3PAFGLGNBGF3HSZNUF7UKIJOYSGEJQ6BE3QA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.926398079 (22h15m56.085163813s) [noise=true , address=89.149.201.147:4018 , piece_id=WBJYJQ3Q3VEFQOSXDHU47OUP74YWNZCRZVVQ2Y3ADWABD3W72SZA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.926420713 (22h15m56.085186447s) [noise=true , address=89.149.201.147:4016 , piece_id=X3HPXYHLV7GZ7TFU535HMR24XYA5VJZVY3CM7RELZOYGOHSZJRNA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.930700252 (22h15m56.089465986s) [noise=true , address=89.149.201.147:4009 , piece_id=JKWPVNAT7SJRSH4C7UF3ZF73ZRKMIVFAN6V2SCKASK4EY5UXRXAQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.937335941 (22h15m56.096101665s) [noise=true , address=89.149.201.147:4010 , piece_id=KVJA344LS2EMOGPEJD52IAABIJVAJ6UDJRTQVT7E6NCQPN2YUS2A, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.938053063 (22h15m56.096818797s) [noise=true , address=89.149.201.147:4020 , piece_id=UUJX36AMEFLBTEAZPARWPSHDLY6CVQMEETGVETVYTC23TFTCXNKA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.939703531 (22h15m56.098469265s) [noise=true , address=89.149.201.147:4002 , piece_id=DGYVORIRHYKVDB3GSGD2CINO4CY24P7Z5625NCF4OF7HG4HG3ZWQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:30.412006837 (22h15m57.570772571s) [noise=true , address=185.167.204.206:4063 , piece_id=KRVQB2NGHL7BNXTO3ELXLCG33VUGVNQNOC2Z3XUBVQUQY5BE75XQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.162813829 (22h15m58.321579563s) [noise=true , address=185.167.204.205:4016 , piece_id=7ZCGVI6BJHQ2EVXMHYOGGXKWH4PHZE6FD4HJFTOW7FC7X2DYV3AQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.361418495 (22h15m58.520184269s) [noise=true , address=185.167.204.205:4024 , piece_id=NVCSU3PMKJPRGXNUWW6JPAPGHYRLQKNYLHJZAR7UXMPTJQ5U55AA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.373601578 (22h15m58.532367312s) [noise=true , address=185.167.204.205:4001 , piece_id=6G2GJCMGSZLHBXX3QUNBZIAFOOZ2ZZK5NN3CGVXXMDMFX4E3DZUQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.391137234 (22h15m58.549902958s) [noise=true , address=185.167.204.206:4053 , piece_id=BVF3XLQOVYSQYFRLHCAZLHVYMFI2SSDTCZFXK5PF2IG2BJPOP64A, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.472152042 (22h15m58.630917776s) [noise=true , address=185.167.204.205:4035 , piece_id=RQX5ZAR5PCXKVYZEKLR4NZAI273IWSRB45KHUV47YHKJ4VLWJDRA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.482208767 (22h15m58.640974491s) [noise=true , address=185.167.204.205:4008 , piece_id=UY2ZD2KVKHB6P5BCRJ6ZE6FWHJAUTEBA2AW2I7ZSTPBZILT2MBFQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.628333689 (22h15m58.787099423s) [noise=true , address=185.167.204.206:4069 , piece_id=ORC4DFNAWKPULKIOANUP6NL52GL6B4E5VX5ZTRC5MNAZCPR4XRSQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.824959158 (22h15m58.983724882s) [noise=true , address=185.167.204.206:4064 , piece_id=4FW2BKL3IEZPQ22DAZ3DCTCBVG6VB4WY6AA2KMLOZGPQB6KDUCHA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:32.900931138 (22h16m0.059696872s) [noise=true , address=185.167.204.206:4046 , piece_id=OGNNYTWXVQN7IOQHRFR5WDOUSA6K5AACNFMSLFFYXBF2IZ4QOYTQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:35.746197351 (22h16m2.904963085s) [noise=true , address=185.167.204.206:4068 , piece_id=4GUQCDVFRGUJLRG7SANEL53BNI7Z4KIOGPBVMKFQV4U4Y2EEM3ZA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:35.746215235 (22h16m2.904980969s) [seg_pos={0 0}, upload=19456]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:19:35.746313614 (22h16m2.905079348s) [noise=true , address=185.167.204.206:4040 , piece_id=3745FYPS3Y5VEYNN4Z3SUXXDCLC4UB3KLEDM5E2IJUATKFKU2QTQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT): protocol: expected piece hash; context canceled; EOF
Aug 26 14:19:35.746508296 (22h16m2.90527403s) [noise=true , address=185.167.204.206:4054 , piece_id=IOAC34RFMFJYTWN4KD6W2WKFHYDBJXJBDCN4ONTOQBPL6MUPHWGA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u): protocol: read tcp 188.166.225.170:45962->185.167.204.206:4054: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Aug 26 14:19:35.746528024 (22h16m2.905293758s) [seg_pos={0 0}, upload=19456]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:19:35.746588289 (22h16m2.905354023s) [upload=19456]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:19:35.746592136 (22h16m2.90535786s) [upload=19456]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:19:36.006261333 (22h16m3.165027067s) [upload=19456]: Done uploading segments...
Aug 26 14:19:36.006282985 (22h16m3.165048719s) [upload=19456]: Upload finished. err: <nil>
Duration: 39.275036497s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
28 out of 60 is failed (threshold=3) [...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.XXX.X.XXX] duration:
1m0.002140708s
FAIL (2025-08-26 14:20:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
IOQHRFR5WDOUSA6K5AACNFMSLFFYXBF2IZ4QOYTQ, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.630152989 (22h15m54.788918713s) [noise=true , address=81.171.14.70:4026 , piece_id=AVEGP3TUJZQIYSIWHOWJDA4DQ4ERT7BF2P6REETU4SODCKJ5NSBA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.630417465 (22h15m54.789183199s) [noise=true , address=185.167.204.206:4068 , piece_id=4GUQCDVFRGUJLRG7SANEL53BNI7Z4KIOGPBVMKFQV4U4Y2EEM3ZA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.630680758 (22h15m54.789446492s) [noise=true , address=185.167.204.206:4069 , piece_id=ORC4DFNAWKPULKIOANUP6NL52GL6B4E5VX5ZTRC5MNAZCPR4XRSQ, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.630726506 (22h15m54.78949224s) [noise=true , address=185.167.204.206:4040 , piece_id=3745FYPS3Y5VEYNN4Z3SUXXDCLC4UB3KLEDM5E2IJUATKFKU2QTQ, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.631015388 (22h15m54.789781112s) [noise=true , address=89.149.201.147:4005 , piece_id=EZVRZF5HSYGYLA47S2THDO65CMP5IVYWW66WJYR7ADUPGDRJJ6VA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.631070133 (22h15m54.789835867s) [noise=true , address=89.149.201.147:4020 , piece_id=UUJX36AMEFLBTEAZPARWPSHDLY6CVQMEETGVETVYTC23TFTCXNKA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.631311806 (22h15m54.79007754s) [noise=true , address=185.167.204.205:4008 , piece_id=UY2ZD2KVKHB6P5BCRJ6ZE6FWHJAUTEBA2AW2I7ZSTPBZILT2MBFQ, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.631594097 (22h15m54.790359821s) [noise=true , address=185.167.204.205:4035 , piece_id=RQX5ZAR5PCXKVYZEKLR4NZAI273IWSRB45KHUV47YHKJ4VLWJDRA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.631613693 (22h15m54.790379427s) [noise=true , address=81.171.14.70:4042 , piece_id=S4LF2LKN7DWHNT4LQ53UULSG3JZADPA3LBRUE267CMOXY2OJAHIA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.632043065 (22h15m54.790808799s) [noise=true , address=81.171.14.70:4046 , piece_id=HVJWVAUDDFAIGJ4L2YXUKLSS25SAQTOIVWS32AVDUNE6LITNB6AA, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.634809789 (22h15m54.793575523s) [noise=true , address=89.149.201.147:4009 , piece_id=JKWPVNAT7SJRSH4C7UF3ZF73ZRKMIVFAN6V2SCKASK4EY5UXRXAQ, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:27.635896699 (22h15m54.794662433s) [noise=true , address=185.167.204.206:4053 , piece_id=BVF3XLQOVYSQYFRLHCAZLHVYMFI2SSDTCZFXK5PF2IG2BJPOP64A, seg_pos={0 0}, upload=19456]: Uploading piece...
Aug 26 14:19:28.459451849 (22h15m55.618217583s) [upload=19456]: Next returned nil segment
Aug 26 14:19:28.459472579 (22h15m55.618238313s) [upload=19456]: Waiting for error group managing segments...
Aug 26 14:19:28.837923547 (22h15m55.996689281s) [noise=true , address=81.171.14.70:4034 , piece_id=GSM5NSP7F4FVCHS7G4LKRK7L2VJOIHHAKOH6CDNMJA7IPWUFOLMA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.860181559 (22h15m56.018947283s) [noise=true , address=81.171.14.70:4042 , piece_id=S4LF2LKN7DWHNT4LQ53UULSG3JZADPA3LBRUE267CMOXY2OJAHIA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.864545660 (22h15m56.023311384s) [noise=true , address=81.171.14.70:4026 , piece_id=AVEGP3TUJZQIYSIWHOWJDA4DQ4ERT7BF2P6REETU4SODCKJ5NSBA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.869161202 (22h15m56.027926936s) [noise=true , address=81.171.14.70:4039 , piece_id=MZEG7T3HVSHIGDIR3IGMIGKYKJA7GWG5DWQJHBRINY47SW22NH3Q, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.879827523 (22h15m56.038593257s) [noise=true , address=81.171.14.70:4046 , piece_id=HVJWVAUDDFAIGJ4L2YXUKLSS25SAQTOIVWS32AVDUNE6LITNB6AA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.886473872 (22h15m56.045239596s) [noise=true , address=81.171.14.70:4027 , piece_id=NXWJ5SDPDWE2JVSTMQKVNJRUEEC5DRVR335W3I5EU2TLR3CNVGHQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.895312926 (22h15m56.05407865s) [noise=true , address=81.171.14.70:4038 , piece_id=43M5LZ2PXSHHL7CH2W347TLA46TCHW3DCBPCJTAHUU3RB27H25UA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.895514011 (22h15m56.054279745s) [noise=true , address=89.149.201.147:4005 , piece_id=EZVRZF5HSYGYLA47S2THDO65CMP5IVYWW66WJYR7ADUPGDRJJ6VA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.908547592 (22h15m56.067313316s) [noise=true , address=89.149.201.147:4013 , piece_id=5IBITZI2FANP2DFK3PAFGLGNBGF3HSZNUF7UKIJOYSGEJQ6BE3QA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.926398079 (22h15m56.085163813s) [noise=true , address=89.149.201.147:4018 , piece_id=WBJYJQ3Q3VEFQOSXDHU47OUP74YWNZCRZVVQ2Y3ADWABD3W72SZA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.926420713 (22h15m56.085186447s) [noise=true , address=89.149.201.147:4016 , piece_id=X3HPXYHLV7GZ7TFU535HMR24XYA5VJZVY3CM7RELZOYGOHSZJRNA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.930700252 (22h15m56.089465986s) [noise=true , address=89.149.201.147:4009 , piece_id=JKWPVNAT7SJRSH4C7UF3ZF73ZRKMIVFAN6V2SCKASK4EY5UXRXAQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.937335941 (22h15m56.096101665s) [noise=true , address=89.149.201.147:4010 , piece_id=KVJA344LS2EMOGPEJD52IAABIJVAJ6UDJRTQVT7E6NCQPN2YUS2A, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.938053063 (22h15m56.096818797s) [noise=true , address=89.149.201.147:4020 , piece_id=UUJX36AMEFLBTEAZPARWPSHDLY6CVQMEETGVETVYTC23TFTCXNKA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:28.939703531 (22h15m56.098469265s) [noise=true , address=89.149.201.147:4002 , piece_id=DGYVORIRHYKVDB3GSGD2CINO4CY24P7Z5625NCF4OF7HG4HG3ZWQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:30.412006837 (22h15m57.570772571s) [noise=true , address=185.167.204.206:4063 , piece_id=KRVQB2NGHL7BNXTO3ELXLCG33VUGVNQNOC2Z3XUBVQUQY5BE75XQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.162813829 (22h15m58.321579563s) [noise=true , address=185.167.204.205:4016 , piece_id=7ZCGVI6BJHQ2EVXMHYOGGXKWH4PHZE6FD4HJFTOW7FC7X2DYV3AQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.361418495 (22h15m58.520184269s) [noise=true , address=185.167.204.205:4024 , piece_id=NVCSU3PMKJPRGXNUWW6JPAPGHYRLQKNYLHJZAR7UXMPTJQ5U55AA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.373601578 (22h15m58.532367312s) [noise=true , address=185.167.204.205:4001 , piece_id=6G2GJCMGSZLHBXX3QUNBZIAFOOZ2ZZK5NN3CGVXXMDMFX4E3DZUQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.391137234 (22h15m58.549902958s) [noise=true , address=185.167.204.206:4053 , piece_id=BVF3XLQOVYSQYFRLHCAZLHVYMFI2SSDTCZFXK5PF2IG2BJPOP64A, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.472152042 (22h15m58.630917776s) [noise=true , address=185.167.204.205:4035 , piece_id=RQX5ZAR5PCXKVYZEKLR4NZAI273IWSRB45KHUV47YHKJ4VLWJDRA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.482208767 (22h15m58.640974491s) [noise=true , address=185.167.204.205:4008 , piece_id=UY2ZD2KVKHB6P5BCRJ6ZE6FWHJAUTEBA2AW2I7ZSTPBZILT2MBFQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.628333689 (22h15m58.787099423s) [noise=true , address=185.167.204.206:4069 , piece_id=ORC4DFNAWKPULKIOANUP6NL52GL6B4E5VX5ZTRC5MNAZCPR4XRSQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:31.824959158 (22h15m58.983724882s) [noise=true , address=185.167.204.206:4064 , piece_id=4FW2BKL3IEZPQ22DAZ3DCTCBVG6VB4WY6AA2KMLOZGPQB6KDUCHA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:32.900931138 (22h16m0.059696872s) [noise=true , address=185.167.204.206:4046 , piece_id=OGNNYTWXVQN7IOQHRFR5WDOUSA6K5AACNFMSLFFYXBF2IZ4QOYTQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:35.746197351 (22h16m2.904963085s) [noise=true , address=185.167.204.206:4068 , piece_id=4GUQCDVFRGUJLRG7SANEL53BNI7Z4KIOGPBVMKFQV4U4Y2EEM3ZA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: <nil>
Aug 26 14:19:35.746215235 (22h16m2.904980969s) [seg_pos={0 0}, upload=19456]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:19:35.746313614 (22h16m2.905079348s) [noise=true , address=185.167.204.206:4040 , piece_id=3745FYPS3Y5VEYNN4Z3SUXXDCLC4UB3KLEDM5E2IJUATKFKU2QTQ, seg_pos={0 0}, upload=19456]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT): protocol: expected piece hash; context canceled; EOF
Aug 26 14:19:35.746508296 (22h16m2.90527403s) [noise=true , address=185.167.204.206:4054 , piece_id=IOAC34RFMFJYTWN4KD6W2WKFHYDBJXJBDCN4ONTOQBPL6MUPHWGA, seg_pos={0 0}, upload=19456]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u): protocol: read tcp 188.166.225.170:45962->185.167.204.206:4054: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Aug 26 14:19:35.746528024 (22h16m2.905293758s) [seg_pos={0 0}, upload=19456]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:19:35.746588289 (22h16m2.905354023s) [upload=19456]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:19:35.746592136 (22h16m2.90535786s) [upload=19456]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:19:36.006261333 (22h16m3.165027067s) [upload=19456]: Done uploading segments...
Aug 26 14:19:36.006282985 (22h16m3.165048719s) [upload=19456]: Upload finished. err: <nil>
Duration: 1m0.002162198s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
28 out of 60 is failed (threshold=3) [X...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.XXX.X.XX] duration:
1m0.002870931s
FAIL (2025-08-26 14:19:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
:18:21.656975466 (22h14m48.8157412s) [noise=true , address=185.167.204.206:4051 , piece_id=O7HW2EAKNXHGGHN62DLWMAGFYECJTUMET33YPKK7D4YSHKZ2FMFQ, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.657234882 (22h14m48.816000616s) [noise=true , address=81.171.14.70:4025 , piece_id=V6ZXNRKOKYLQBC7DVLK2UBZB6N7T5RKTRPGQWIZ72OVJ5G3EO6UA, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.657266171 (22h14m48.816031905s) [noise=true , address=89.149.201.147:4001 , piece_id=PANOMQPEZ2IUJPZLTSG5DUEXG4EKH6QMQHBPKMI765BEXJK4HKGQ, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.657489378 (22h14m48.816255112s) [noise=true , address=89.149.201.147:4009 , piece_id=IDGIGBKOAH7AQWOV4VJ56ONWEHJDN6QD7RXZ3MQ4INNA2NPTS36A, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.657723116 (22h14m48.81648885s) [noise=true , address=81.171.14.70:4035 , piece_id=A6XXIBAHNYAVLW2PC7YTBBJMIWY722X2CHJD2USKVTNSRR7MSFIQ, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.657927246 (22h14m48.81669297s) [noise=true , address=185.167.204.206:4041 , piece_id=5ASYPCFIPYYMYNRWGQABH2TOXALG3QGDHZOTBZ2E23EAYOB4UBQA, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.658127390 (22h14m48.816893124s) [noise=true , address=81.171.14.70:4026 , piece_id=ULUFG6RZLIHC5S57OT4CILOCP52E2NXMJNX3T6TXV7CKD3FSYI3Q, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.658342662 (22h14m48.817108396s) [noise=true , address=185.167.204.206:4057 , piece_id=GBGTYL2MLDVETHAIGZ5KAKETITNDBPYSVXNRRGEGVSJIMPVD6ONQ, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.658508509 (22h14m48.817274233s) [noise=true , address=185.167.204.206:4040 , piece_id=LAJY2E7YLVWGBA2Y2D2YLLD4IITUME55AIVMGGJZBGUEXPDFIYCQ, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.658588021 (22h14m48.817353755s) [noise=true , address=185.167.204.205:4013 , piece_id=DMBQZTIXPNRVTKHHBAVLLTSS5KGYTVBKN4LQYIHRTBRM4O7YNQDQ, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.658707570 (22h14m48.817473304s) [noise=true , address=185.167.204.206:4068 , piece_id=KEOAOBYH5N35DRWNPAGWE5VC3PQPWFZFCJK5YUG6OGGE43L3MF5A, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.658917712 (22h14m48.817683446s) [noise=true , address=185.167.204.206:4045 , piece_id=7JR2NICSVMTKQJGE2RQKXMSGVQA2OPJ2MO44UC5AINQCU3E6CQ6A, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:21.659100080 (22h14m48.817865814s) [noise=true , address=81.171.14.70:4031 , piece_id=UZY77CKG6HW3OYBUUOH7H5TG4JBYDPCPZO45DPWXXUGOU456HL6A, seg_pos={0 0}, upload=19442]: Uploading piece...
Aug 26 14:18:22.495280181 (22h14m49.654045915s) [upload=19442]: Next returned nil segment
Aug 26 14:18:22.495297013 (22h14m49.654062747s) [upload=19442]: Waiting for error group managing segments...
Aug 26 14:18:22.870527737 (22h14m50.029293471s) [noise=true , address=81.171.14.70:4035 , piece_id=A6XXIBAHNYAVLW2PC7YTBBJMIWY722X2CHJD2USKVTNSRR7MSFIQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.893711401 (22h14m50.052477135s) [noise=true , address=89.149.201.147:4009 , piece_id=IDGIGBKOAH7AQWOV4VJ56ONWEHJDN6QD7RXZ3MQ4INNA2NPTS36A, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.894812839 (22h14m50.053578563s) [noise=true , address=89.149.201.147:4002 , piece_id=XBW372SQPDT7XJJ7U3LSZRRZNRYLZTFXJVMB6JHVZY4KG4VJGGKQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.896399376 (22h14m50.0551651s) [noise=true , address=81.171.14.70:4033 , piece_id=ZHEEKBLEJWGAFUGH7MUCSKLHYGLMF5DYZUOHONW57CH2OG7CHIMA, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.899123848 (22h14m50.057889572s) [noise=true , address=81.171.14.70:4046 , piece_id=ODLSY5OJAGS2JOJCBM5RD7LUYHFVNV4ZIXUZPBBETHOS7OI2C7GQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.931843931 (22h14m50.090609665s) [noise=true , address=89.149.201.147:4018 , piece_id=NLQPHTDZP6EODJXDFUGUF7T5QCQ4XEDA345YM23ASGMMGX3WFLIQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.934135176 (22h14m50.09290091s) [noise=true , address=89.149.201.147:4010 , piece_id=3PV54OIQGL7Q2XS37HYQWTQKEX4KC5WX2XMCITZDMX7DFUWY3EEQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.935321846 (22h14m50.09408757s) [noise=true , address=81.171.14.70:4025 , piece_id=V6ZXNRKOKYLQBC7DVLK2UBZB6N7T5RKTRPGQWIZ72OVJ5G3EO6UA, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.936716465 (22h14m50.095482199s) [noise=true , address=81.171.14.70:4034 , piece_id=BF2IGPPJK5NNM3UPFZBMJENL747HZ6OTAMV2N4UOZAQQYM5KCZLA, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.941553290 (22h14m50.100319015s) [noise=true , address=81.171.14.70:4031 , piece_id=UZY77CKG6HW3OYBUUOH7H5TG4JBYDPCPZO45DPWXXUGOU456HL6A, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.944478278 (22h14m50.103244002s) [noise=true , address=81.171.14.70:4037 , piece_id=2DQJ6TU3FOUXWJUYL2XN6TL4VB5N4B7V54HSVVGWYK6EUK3FPJHQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.951009195 (22h14m50.109774929s) [noise=true , address=81.171.14.70:4026 , piece_id=ULUFG6RZLIHC5S57OT4CILOCP52E2NXMJNX3T6TXV7CKD3FSYI3Q, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:22.959346259 (22h14m50.118111994s) [noise=true , address=89.149.201.147:4001 , piece_id=PANOMQPEZ2IUJPZLTSG5DUEXG4EKH6QMQHBPKMI765BEXJK4HKGQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:24.421518276 (22h14m51.58028401s) [noise=true , address=185.167.204.205:4034 , piece_id=37E7EDGIXLWAGDYDBFDOQ2WZT6SQWROASAXP4P6XFNKISAQFDATA, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:24.425245067 (22h14m51.584010801s) [noise=true , address=185.167.204.206:4040 , piece_id=LAJY2E7YLVWGBA2Y2D2YLLD4IITUME55AIVMGGJZBGUEXPDFIYCQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:24.435156354 (22h14m51.593922088s) [noise=true , address=185.167.204.206:4061 , piece_id=TNIIIVCXV6QWNP56BI2FBTCQMFJR5533DI6BC2FDAKYDP32EP6SQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:24.437621402 (22h14m51.596387136s) [noise=true , address=185.167.204.205:4023 , piece_id=GBIERNWJRAD6SJ3ZC2PBJHGGNDA5MZZ6C3SE7FDVNEPNHR7J3PMA, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:24.454058044 (22h14m51.612823778s) [noise=true , address=185.167.204.206:4045 , piece_id=7JR2NICSVMTKQJGE2RQKXMSGVQA2OPJ2MO44UC5AINQCU3E6CQ6A, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:24.468301350 (22h14m51.627067084s) [noise=true , address=185.167.204.205:4021 , piece_id=7CAGSUXD46JPWENPJKYMRGSG6NNDWDDZJ2RXO6Q6RZKIPKTQLOQQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:24.561433156 (22h14m51.72019899s) [noise=true , address=185.167.204.205:4013 , piece_id=DMBQZTIXPNRVTKHHBAVLLTSS5KGYTVBKN4LQYIHRTBRM4O7YNQDQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:24.594368981 (22h14m51.753134715s) [noise=true , address=185.167.204.206:4057 , piece_id=GBGTYL2MLDVETHAIGZ5KAKETITNDBPYSVXNRRGEGVSJIMPVD6ONQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:24.652513245 (22h14m51.811278979s) [noise=true , address=185.167.204.205:4003 , piece_id=YTYRQXM5ZY3374PYCPGPZ5VGDO7IBYAMNKEMUKK3K26BI33MP5RA, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:24.800874777 (22h14m51.959640501s) [noise=true , address=185.167.204.206:4044 , piece_id=LEKMCI7HHULQQ6LUGBW6QWL45VHNTURW2M4FGZQRQZ7TXFO3P6YA, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:25.846052233 (22h14m53.004818007s) [noise=true , address=185.167.204.206:4041 , piece_id=5ASYPCFIPYYMYNRWGQABH2TOXALG3QGDHZOTBZ2E23EAYOB4UBQA, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:26.766597301 (22h14m53.925363035s) [noise=true , address=185.167.204.206:4068 , piece_id=KEOAOBYH5N35DRWNPAGWE5VC3PQPWFZFCJK5YUG6OGGE43L3MF5A, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:26.929138447 (22h14m54.087904181s) [noise=true , address=185.167.204.206:4051 , piece_id=O7HW2EAKNXHGGHN62DLWMAGFYECJTUMET33YPKK7D4YSHKZ2FMFQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: <nil>
Aug 26 14:18:26.929168434 (22h14m54.087934158s) [seg_pos={0 0}, upload=19442]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:18:26.929286159 (22h14m54.088051883s) [noise=true , address=185.167.204.205:4001 , piece_id=UXTUJ7WRO3KHHAS6NIDLFC33FUAXL7ES4O6CUR47GFMNVF4ZMEHQ, seg_pos={0 0}, upload=19442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91): protocol: expected piece hash; context canceled; EOF
Aug 26 14:18:26.929422550 (22h14m54.088188284s) [noise=true , address=185.167.204.205:4015 , piece_id=DBY7UUM4BZ23IJZJF6POHJRLDRG2HPCJPE652TKMZWEWAG52BJ3Q, seg_pos={0 0}, upload=19442]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX): protocol: expected piece hash; context canceled; EOF
Aug 26 14:18:26.929469891 (22h14m54.088235625s) [seg_pos={0 0}, upload=19442]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:18:26.929562808 (22h14m54.088328542s) [upload=19442]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:18:26.929567186 (22h14m54.08833292s) [upload=19442]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:18:27.188156750 (22h14m54.346922484s) [upload=19442]: Done uploading segments...
Aug 26 14:18:27.188174094 (22h14m54.346939828s) [upload=19442]: Upload finished. err: <nil>
Duration: 1m0.002887392s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
28 out of 60 is failed (threshold=3) [XX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.XXX.X.X] duration:
1m0.003311817s
FAIL (2025-08-26 14:18:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
WFEG6J25HVIOV3BS2QF2A2P5FAJOOUQ, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.397354899 (22h13m48.556120633s) [noise=true , address=81.171.14.70:4026 , piece_id=5RYKVK32J3MKSEINDCO3ATF3U6WU62LCZYEKHAAJOW7G7WGJM3DA, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.397555051 (22h13m48.556320785s) [noise=true , address=89.149.201.147:4018 , piece_id=QABBSXK47SIIMIBNQDZMUPH4SF5F4WVPMD7QSUQA4BLRGGQI7WLA, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.397691041 (22h13m48.556456775s) [noise=true , address=89.149.201.147:4001 , piece_id=2JPUR3TBEJONE5FVEFQS6JWV5WK2BFRLR7JUFHGWBY3VHFTFOBSQ, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.397751577 (22h13m48.556517311s) [noise=true , address=185.167.204.206:4061 , piece_id=KV43H7H4ARMW7EZFBYJWUWWDSZTFQV2RQHXD6GJ6HT365VNMCBZQ, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.397980295 (22h13m48.556746019s) [noise=true , address=185.167.204.206:4064 , piece_id=NBK5772YNZGMM2V4ZKPPXBUW6W3GXJ7H6CAADTOJNNKJVXFJSQ7Q, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.398159808 (22h13m48.556925542s) [noise=true , address=89.149.201.147:4022 , piece_id=35RXDDVQXI7LCUSA3TRIXJHXMVTBTCOIO7C56ZXHLGORDLLRGVHA, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.398657421 (22h13m48.557423155s) [noise=true , address=89.149.201.147:4012 , piece_id=7VVLB3J6D6DGVWHCGCHAOUAL4E3KRC2WFKLVCD7PO4P56ZED7UNQ, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.399019173 (22h13m48.557784907s) [noise=true , address=81.171.14.70:4030 , piece_id=WR4GMP7OONOEHJJFNRUOV4JBVLH5YZOOJLMLB6BFV3Y37BRLKVUQ, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.399876644 (22h13m48.558642378s) [noise=true , address=185.167.204.205:4016 , piece_id=BACYV6ZTSP7TJEF2KOIYE2KZN5MBP4PTP5CNYPKCUKMM7L7SL2BQ, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.400744044 (22h13m48.559509778s) [noise=true , address=89.149.201.147:4024 , piece_id=UY4RXJQPRDZ7EK4JMVDFLYTDA6GBHEGMKWNFKX5KEFOCHT53SHDQ, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.401145051 (22h13m48.559910785s) [noise=true , address=185.167.204.205:4025 , piece_id=LNCT4VPRDMD6RCDHYMOOE2EFG2HVP5TQTQT6D7VOPDSDR2KSS6DA, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:21.413762856 (22h13m48.57252859s) [noise=true , address=185.167.204.206:4063 , piece_id=LCS6SGCSWQ355ZJMECXJE62VPOCFUZJXVP3FWAPYMASOJOW5TAXQ, seg_pos={0 0}, upload=19426]: Uploading piece...
Aug 26 14:17:22.236773103 (22h13m49.395538837s) [upload=19426]: Next returned nil segment
Aug 26 14:17:22.236788183 (22h13m49.395553917s) [upload=19426]: Waiting for error group managing segments...
Aug 26 14:17:22.623401199 (22h13m49.782166983s) [noise=true , address=81.171.14.70:4036 , piece_id=3V7ZACWSDY4HJFHBEEPJLD7KXSCERMCZXDY4SW6I5IVZTY62ZGUA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.631977680 (22h13m49.790743414s) [noise=true , address=81.171.14.70:4026 , piece_id=5RYKVK32J3MKSEINDCO3ATF3U6WU62LCZYEKHAAJOW7G7WGJM3DA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.656867108 (22h13m49.815632842s) [noise=true , address=89.149.201.147:4004 , piece_id=6T5HFOIBJKCIQCYLLBBKAVDFZY4BYAQYXP6WRZA7G4FLBJQFNULA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.671718217 (22h13m49.830483951s) [noise=true , address=81.171.14.70:4033 , piece_id=7YGBPQYYIZSQCVMNRHTNEHBF7ANUA7XMKHL2J76CQYN25IAEWDJA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.674482426 (22h13m49.833248161s) [noise=true , address=81.171.14.70:4032 , piece_id=SKVQTOKIQKA4PLYY2ROLLZFNEHT7TLANICBXNFTUYRX3CXTBGSAA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.675749591 (22h13m49.834515325s) [noise=true , address=89.149.201.147:4021 , piece_id=GM77LOQQ7LI3NRYZ3RTGUNGRXTLKH66IZI36HM4ZKKBMWB5YIXIQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.686876914 (22h13m49.845642648s) [noise=true , address=89.149.201.147:4018 , piece_id=QABBSXK47SIIMIBNQDZMUPH4SF5F4WVPMD7QSUQA4BLRGGQI7WLA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.689174651 (22h13m49.847940385s) [noise=true , address=89.149.201.147:4001 , piece_id=2JPUR3TBEJONE5FVEFQS6JWV5WK2BFRLR7JUFHGWBY3VHFTFOBSQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.700453514 (22h13m49.859219258s) [noise=true , address=89.149.201.147:4012 , piece_id=7VVLB3J6D6DGVWHCGCHAOUAL4E3KRC2WFKLVCD7PO4P56ZED7UNQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.704967071 (22h13m49.863732805s) [noise=true , address=81.171.14.70:4030 , piece_id=WR4GMP7OONOEHJJFNRUOV4JBVLH5YZOOJLMLB6BFV3Y37BRLKVUQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.706123885 (22h13m49.864889619s) [noise=true , address=89.149.201.147:4024 , piece_id=UY4RXJQPRDZ7EK4JMVDFLYTDA6GBHEGMKWNFKX5KEFOCHT53SHDQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.711535721 (22h13m49.870301455s) [noise=true , address=89.149.201.147:4022 , piece_id=35RXDDVQXI7LCUSA3TRIXJHXMVTBTCOIO7C56ZXHLGORDLLRGVHA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:22.767628860 (22h13m49.926394594s) [noise=true , address=89.149.201.147:4010 , piece_id=Y6HEBPO5TKTMOKPAKMBEKPQV35IF5NMIJDKXDMXDAYYC2HI4IYIA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:24.216498771 (22h13m51.375264505s) [noise=true , address=185.167.204.206:4044 , piece_id=SIW4YMPANIO3KU6TEZOYAZEHIWUAG626QI55CUIMOVKHOSYRBNCQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:24.260650680 (22h13m51.419416414s) [noise=true , address=185.167.204.206:4064 , piece_id=NBK5772YNZGMM2V4ZKPPXBUW6W3GXJ7H6CAADTOJNNKJVXFJSQ7Q, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:24.389441031 (22h13m51.548206765s) [noise=true , address=185.167.204.205:4010 , piece_id=GAQ7T4XEOBQMEI72KSSYQDY24JOPM5NDEKNZ3L3JFSSGIYYYTSCA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:24.567256706 (22h13m51.72602243s) [noise=true , address=185.167.204.206:4063 , piece_id=LCS6SGCSWQ355ZJMECXJE62VPOCFUZJXVP3FWAPYMASOJOW5TAXQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:24.650880707 (22h13m51.809646441s) [noise=true , address=185.167.204.205:4028 , piece_id=OS4SGCRD7V2RJ4FEPLOOVHGVJDVGAVHWL7WRZGZTRICFRM2DOX3Q, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:24.758249967 (22h13m51.917015701s) [noise=true , address=185.167.204.206:4061 , piece_id=KV43H7H4ARMW7EZFBYJWUWWDSZTFQV2RQHXD6GJ6HT365VNMCBZQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:24.779203183 (22h13m51.937968917s) [noise=true , address=185.167.204.206:4058 , piece_id=DATDJTYVJHKLDSJNFB65BANWCQ6X7B2OZYWCBGGYK7KVUQMFO3SQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:24.997056734 (22h13m52.155822468s) [noise=true , address=185.167.204.206:4062 , piece_id=27EA7TYXFYUOJWBAC3IJXWFEG6J25HVIOV3BS2QF2A2P5FAJOOUQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:26.117043981 (22h13m53.275809705s) [noise=true , address=185.167.204.205:4007 , piece_id=DZZBICHWEIU4HGFTDP6YCGEKNQLMQJFW5MF6CFJ7WRGAUAEJKZRQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:26.216289126 (22h13m53.37505486s) [noise=true , address=185.167.204.205:4025 , piece_id=LNCT4VPRDMD6RCDHYMOOE2EFG2HVP5TQTQT6D7VOPDSDR2KSS6DA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:26.405736238 (22h13m53.564501972s) [noise=true , address=185.167.204.205:4020 , piece_id=EGPI7GCBDHNZ2PKPE6P26BS33A4HYSYEBQ4GUUV6UOKBNITWHICQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:26.725633247 (22h13m53.884398981s) [noise=true , address=185.167.204.205:4016 , piece_id=BACYV6ZTSP7TJEF2KOIYE2KZN5MBP4PTP5CNYPKCUKMM7L7SL2BQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:26.782659922 (22h13m53.941425656s) [noise=true , address=185.167.204.205:4001 , piece_id=PIDYUWAKTZ5CL5KYKERBZF3JIH3ID467E5LXIEVDK3UL6NHV7Z7A, seg_pos={0 0}, upload=19426]: Done uploading piece. err: <nil>
Aug 26 14:17:26.782684770 (22h13m53.941450504s) [seg_pos={0 0}, upload=19426]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:17:26.782906214 (22h13m53.941671948s) [noise=true , address=185.167.204.205:4029 , piece_id=SNDO5HD42YCZ3ARM6TTLWA5SD3M6XBHY4YUKQ6LESL3QQFILWXDA, seg_pos={0 0}, upload=19426]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn): protocol: read tcp 188.166.225.170:49756->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 26 14:17:26.782996185 (22h13m53.94176192s) [noise=true , address=185.167.204.205:4036 , piece_id=GARQ4SKEZEKZ2AH63ZBOZBRKK2IEMVZY7AI4NGPGB2CE7DXDM4KQ, seg_pos={0 0}, upload=19426]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV): protocol: expected piece hash; context canceled; EOF
Aug 26 14:17:26.783045370 (22h13m53.941811104s) [seg_pos={0 0}, upload=19426]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:17:26.783146514 (22h13m53.941912248s) [upload=19426]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:17:26.783152866 (22h13m53.9419186s) [upload=19426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:17:27.027111400 (22h13m54.185877124s) [upload=19426]: Done uploading segments...
Aug 26 14:17:27.027128814 (22h13m54.185894538s) [upload=19426]: Upload finished. err: <nil>
Duration: 1m0.003338469s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
28 out of 60 is failed (threshold=3) [XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.XXX.X.] duration:
15.015408403s
FAIL (2025-08-26 14:16:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
9401]: Uploading piece...
Aug 26 14:15:38.114361011 (22h12m5.273126745s) [noise=true , address=81.171.14.70:4026 , piece_id=MYPX7QAH2FADCYHHRQCSNPDHW46ZTFE4YKIEQJOWKLTS76V37HWA, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.114757801 (22h12m5.273523535s) [noise=true , address=185.167.204.206:4061 , piece_id=XRGY62YTI5VVF5HCSHAGHRENFACV5KYSV2KRACYFWKSUDMQINC2Q, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.114957834 (22h12m5.273723568s) [noise=true , address=185.167.204.205:4035 , piece_id=EEUBGQRAS2H6GP4JICW4IB2SK7Y3JMFCFYSJO4PKT6KI7GMPSTKA, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.115145082 (22h12m5.273910826s) [noise=true , address=89.149.201.147:4002 , piece_id=RWIKKLK4SGK5TO7Q7XEOQM7ZMUZTYM5O2ZRMY42AER2W6M6TQWLQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.115521092 (22h12m5.274286826s) [noise=true , address=81.171.14.70:4033 , piece_id=QGEPMO2D6ERNDF6DZ4IKL6CXU5QMX3JCU4O2TJ3KGAGCVOV2XLIQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.116672845 (22h12m5.27543858s) [noise=true , address=89.149.201.147:4016 , piece_id=G5LDYZMDRZC6H6BDESJCI7QJADOG2PJJ7ZHEFQ247L2OL3ZYLNCQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.116961669 (22h12m5.275727403s) [noise=true , address=185.167.204.206:4066 , piece_id=53JABB4NV6YOTR5W7P3JFJJTATJBBKN3NQZ6MO2KITDKXW2FBJFA, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.117234521 (22h12m5.276000255s) [noise=true , address=185.167.204.205:4022 , piece_id=5PZRHLYRFWDUWFRVHX7UBEH3ZP6HYEUDD64VHH74O6UQBYQB3RFQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.117547629 (22h12m5.276313363s) [noise=true , address=81.171.14.70:4027 , piece_id=CIGLJAXFJG6XP2ARGJSF4XDZJ2DUYPFOL3BRC4RJ2WWSEN623C6Q, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.117937666 (22h12m5.276703411s) [noise=true , address=89.149.201.147:4024 , piece_id=C7DXTNTAJZSKWONX3OWSXKNBGVP2MFA64EOOEWXBAWRGU2QIFZIA, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.118276134 (22h12m5.277041868s) [noise=true , address=81.171.14.70:4038 , piece_id=GXO5NY4MWNSE6LP6OQ4L3CGXXOVUMFW253M262XVBRJPYITM4GZQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.118610213 (22h12m5.277375947s) [noise=true , address=89.149.201.147:4007 , piece_id=TC6NGHC37ZJJA7377WLBNLOQVFJVLQMKRBXPUMOSF7DZMCAR4XLQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.118889959 (22h12m5.277655693s) [noise=true , address=81.171.14.70:4031 , piece_id=SXQRQ5RIKHOENQVZHUCJAHBQ3W74SWJBCCKXXTMRDBXNMNBTBZZA, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.955514799 (22h12m6.114280533s) [upload=19401]: Next returned nil segment
Aug 26 14:15:38.955569063 (22h12m6.114334797s) [upload=19401]: Waiting for error group managing segments...
Aug 26 14:15:39.330896643 (22h12m6.489662377s) [noise=true , address=81.171.14.70:4031 , piece_id=SXQRQ5RIKHOENQVZHUCJAHBQ3W74SWJBCCKXXTMRDBXNMNBTBZZA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.333054733 (22h12m6.491820467s) [noise=true , address=81.171.14.70:4039 , piece_id=WTUQR2PL6VWK765WPUJA5VAHUBFFO7CMN73SKM43FXY2QTVWOUIQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.353532739 (22h12m6.512298473s) [noise=true , address=81.171.14.70:4026 , piece_id=MYPX7QAH2FADCYHHRQCSNPDHW46ZTFE4YKIEQJOWKLTS76V37HWA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.360130064 (22h12m6.518895838s) [noise=true , address=89.149.201.147:4021 , piece_id=GMRN367TNZFSVGJJQSBZKJJZJTRFYD2XL4GIM4YM3KGGWEIKKQ7Q, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.372247251 (22h12m6.531012985s) [noise=true , address=81.171.14.70:4048 , piece_id=OLMSFYITEMFHYBBBJUUGQHCATJYPFCIMKR3SGK5PC7SIW3VVU2YQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.377419799 (22h12m6.536185533s) [noise=true , address=81.171.14.70:4042 , piece_id=MS3WIEAQR4IBGXOFIC3OWEHGHOZSM6BV7SQINZXQHTKB3EHZ4FKQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.380032698 (22h12m6.538798443s) [noise=true , address=81.171.14.70:4028 , piece_id=F74AOCRPEDYSFWWUBUBC7LIUVZVO5MLRL54YTO7FWPF73QV6FLYQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.390223921 (22h12m6.548989655s) [noise=true , address=81.171.14.70:4033 , piece_id=QGEPMO2D6ERNDF6DZ4IKL6CXU5QMX3JCU4O2TJ3KGAGCVOV2XLIQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.395384826 (22h12m6.55415057s) [noise=true , address=89.149.201.147:4013 , piece_id=SJUUBXT2KXXZYWAFA7MCNYWCQMWUYMENSCEF5K2OII5BJ6A6ZB3A, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.402376615 (22h12m6.56114236s) [noise=true , address=89.149.201.147:4002 , piece_id=RWIKKLK4SGK5TO7Q7XEOQM7ZMUZTYM5O2ZRMY42AER2W6M6TQWLQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.408793355 (22h12m6.567559089s) [noise=true , address=81.171.14.70:4038 , piece_id=GXO5NY4MWNSE6LP6OQ4L3CGXXOVUMFW253M262XVBRJPYITM4GZQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.411168671 (22h12m6.569934405s) [noise=true , address=81.171.14.70:4027 , piece_id=CIGLJAXFJG6XP2ARGJSF4XDZJ2DUYPFOL3BRC4RJ2WWSEN623C6Q, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.432251313 (22h12m6.591017077s) [noise=true , address=89.149.201.147:4024 , piece_id=C7DXTNTAJZSKWONX3OWSXKNBGVP2MFA64EOOEWXBAWRGU2QIFZIA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.439028192 (22h12m6.597793916s) [noise=true , address=89.149.201.147:4016 , piece_id=G5LDYZMDRZC6H6BDESJCI7QJADOG2PJJ7ZHEFQ247L2OL3ZYLNCQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.482959558 (22h12m6.641725292s) [noise=true , address=89.149.201.147:4007 , piece_id=TC6NGHC37ZJJA7377WLBNLOQVFJVLQMKRBXPUMOSF7DZMCAR4XLQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:40.888900213 (22h12m8.047665947s) [noise=true , address=185.167.204.206:4051 , piece_id=XZJTZW2W6CINGDQMZWZKY5H6O32Z4OEV4VD7RJS63LAZK4JX7NPQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:40.908435085 (22h12m8.067200809s) [noise=true , address=185.167.204.206:4063 , piece_id=ANCZTJDYTZGGVB4EXVZPFQV54XCQITWXL2XPH4OYNQKJD7JRACHQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:41.001559908 (22h12m8.160325642s) [noise=true , address=185.167.204.205:4006 , piece_id=7P4PLTESMLLBQCSIF32FOKZF4I47J6VXOUDV5DIHLATYT5JT5JCA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:41.059395351 (22h12m8.218161085s) [noise=true , address=185.167.204.206:4061 , piece_id=XRGY62YTI5VVF5HCSHAGHRENFACV5KYSV2KRACYFWKSUDMQINC2Q, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:41.322411905 (22h12m8.481177639s) [noise=true , address=185.167.204.206:4064 , piece_id=ODNVCCIFT3AEGL6FCVRJDTP6M7OJ4KTYJP4FKNQ2JGYJWR7RHY2Q, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:41.375728041 (22h12m8.534493765s) [noise=true , address=185.167.204.205:4035 , piece_id=EEUBGQRAS2H6GP4JICW4IB2SK7Y3JMFCFYSJO4PKT6KI7GMPSTKA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:41.398510607 (22h12m8.557276341s) [noise=true , address=185.167.204.205:4005 , piece_id=XHZDTH5CINOWD6FTMQ7ZARZ5QUVZMX6AVI7MCWFHSTQRHO4SODSQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:42.019955883 (22h12m9.178721627s) [noise=true , address=185.167.204.205:4016 , piece_id=B5L7QLNK4JEGZF6HV2XUBR25747QKTTUHKZLLYK4S2HLA2HBFNHA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:42.236706023 (22h12m9.395471757s) [noise=true , address=185.167.204.205:4022 , piece_id=5PZRHLYRFWDUWFRVHX7UBEH3ZP6HYEUDD64VHH74O6UQBYQB3RFQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:42.384569050 (22h12m9.543334784s) [noise=true , address=185.167.204.206:4058 , piece_id=PIVE44O3IREXZJLWZJHUKC3X3OFLKKD3HWP5TOSNOR4RHM2Z2LXQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:45.253331334 (22h12m12.412097068s) [noise=true , address=185.167.204.206:4066 , piece_id=53JABB4NV6YOTR5W7P3JFJJTATJBBKN3NQZ6MO2KITDKXW2FBJFA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:45.253376449 (22h12m12.412142183s) [seg_pos={0 0}, upload=19401]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:15:45.253519914 (22h12m12.412285649s) [noise=true , address=185.167.204.206:4039 , piece_id=3BO7DBWTLRDFOXOH64RW5B64TYGY4EIH7EBJCPDNBLHVASXIVWTQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FV1y64fPXx14kCr3Tng2sYqXdsxaPeRJXmNVJLCVKQNkCo3Y9): protocol: expected piece hash; context canceled; EOF
Aug 26 14:15:45.253526888 (22h12m12.412292622s) [noise=true , address=185.167.204.205:4013 , piece_id=JY4H5IXZASBFEPGTC65LSMGVWIB2I2ZOAIY6HLF34I2T3ZQEEBXQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5): protocol: expected piece hash; context canceled; EOF
Aug 26 14:15:45.253542196 (22h12m12.41230793s) [seg_pos={0 0}, upload=19401]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:15:45.253605688 (22h12m12.412371423s) [upload=19401]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:15:45.253609666 (22h12m12.4123754s) [upload=19401]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:15:45.556770369 (22h12m12.715536103s) [upload=19401]: Done uploading segments...
Aug 26 14:15:45.556790337 (22h12m12.715556071s) [upload=19401]: Upload finished. err: <nil>
Duration: 15.015426297s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
28 out of 60 is failed (threshold=3) [.XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.XXX.X] duration:
1m0.002809935s
FAIL (2025-08-26 14:16:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
9401]: Uploading piece...
Aug 26 14:15:38.114361011 (22h12m5.273126745s) [noise=true , address=81.171.14.70:4026 , piece_id=MYPX7QAH2FADCYHHRQCSNPDHW46ZTFE4YKIEQJOWKLTS76V37HWA, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.114757801 (22h12m5.273523535s) [noise=true , address=185.167.204.206:4061 , piece_id=XRGY62YTI5VVF5HCSHAGHRENFACV5KYSV2KRACYFWKSUDMQINC2Q, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.114957834 (22h12m5.273723568s) [noise=true , address=185.167.204.205:4035 , piece_id=EEUBGQRAS2H6GP4JICW4IB2SK7Y3JMFCFYSJO4PKT6KI7GMPSTKA, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.115145082 (22h12m5.273910826s) [noise=true , address=89.149.201.147:4002 , piece_id=RWIKKLK4SGK5TO7Q7XEOQM7ZMUZTYM5O2ZRMY42AER2W6M6TQWLQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.115521092 (22h12m5.274286826s) [noise=true , address=81.171.14.70:4033 , piece_id=QGEPMO2D6ERNDF6DZ4IKL6CXU5QMX3JCU4O2TJ3KGAGCVOV2XLIQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.116672845 (22h12m5.27543858s) [noise=true , address=89.149.201.147:4016 , piece_id=G5LDYZMDRZC6H6BDESJCI7QJADOG2PJJ7ZHEFQ247L2OL3ZYLNCQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.116961669 (22h12m5.275727403s) [noise=true , address=185.167.204.206:4066 , piece_id=53JABB4NV6YOTR5W7P3JFJJTATJBBKN3NQZ6MO2KITDKXW2FBJFA, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.117234521 (22h12m5.276000255s) [noise=true , address=185.167.204.205:4022 , piece_id=5PZRHLYRFWDUWFRVHX7UBEH3ZP6HYEUDD64VHH74O6UQBYQB3RFQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.117547629 (22h12m5.276313363s) [noise=true , address=81.171.14.70:4027 , piece_id=CIGLJAXFJG6XP2ARGJSF4XDZJ2DUYPFOL3BRC4RJ2WWSEN623C6Q, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.117937666 (22h12m5.276703411s) [noise=true , address=89.149.201.147:4024 , piece_id=C7DXTNTAJZSKWONX3OWSXKNBGVP2MFA64EOOEWXBAWRGU2QIFZIA, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.118276134 (22h12m5.277041868s) [noise=true , address=81.171.14.70:4038 , piece_id=GXO5NY4MWNSE6LP6OQ4L3CGXXOVUMFW253M262XVBRJPYITM4GZQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.118610213 (22h12m5.277375947s) [noise=true , address=89.149.201.147:4007 , piece_id=TC6NGHC37ZJJA7377WLBNLOQVFJVLQMKRBXPUMOSF7DZMCAR4XLQ, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.118889959 (22h12m5.277655693s) [noise=true , address=81.171.14.70:4031 , piece_id=SXQRQ5RIKHOENQVZHUCJAHBQ3W74SWJBCCKXXTMRDBXNMNBTBZZA, seg_pos={0 0}, upload=19401]: Uploading piece...
Aug 26 14:15:38.955514799 (22h12m6.114280533s) [upload=19401]: Next returned nil segment
Aug 26 14:15:38.955569063 (22h12m6.114334797s) [upload=19401]: Waiting for error group managing segments...
Aug 26 14:15:39.330896643 (22h12m6.489662377s) [noise=true , address=81.171.14.70:4031 , piece_id=SXQRQ5RIKHOENQVZHUCJAHBQ3W74SWJBCCKXXTMRDBXNMNBTBZZA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.333054733 (22h12m6.491820467s) [noise=true , address=81.171.14.70:4039 , piece_id=WTUQR2PL6VWK765WPUJA5VAHUBFFO7CMN73SKM43FXY2QTVWOUIQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.353532739 (22h12m6.512298473s) [noise=true , address=81.171.14.70:4026 , piece_id=MYPX7QAH2FADCYHHRQCSNPDHW46ZTFE4YKIEQJOWKLTS76V37HWA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.360130064 (22h12m6.518895838s) [noise=true , address=89.149.201.147:4021 , piece_id=GMRN367TNZFSVGJJQSBZKJJZJTRFYD2XL4GIM4YM3KGGWEIKKQ7Q, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.372247251 (22h12m6.531012985s) [noise=true , address=81.171.14.70:4048 , piece_id=OLMSFYITEMFHYBBBJUUGQHCATJYPFCIMKR3SGK5PC7SIW3VVU2YQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.377419799 (22h12m6.536185533s) [noise=true , address=81.171.14.70:4042 , piece_id=MS3WIEAQR4IBGXOFIC3OWEHGHOZSM6BV7SQINZXQHTKB3EHZ4FKQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.380032698 (22h12m6.538798443s) [noise=true , address=81.171.14.70:4028 , piece_id=F74AOCRPEDYSFWWUBUBC7LIUVZVO5MLRL54YTO7FWPF73QV6FLYQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.390223921 (22h12m6.548989655s) [noise=true , address=81.171.14.70:4033 , piece_id=QGEPMO2D6ERNDF6DZ4IKL6CXU5QMX3JCU4O2TJ3KGAGCVOV2XLIQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.395384826 (22h12m6.55415057s) [noise=true , address=89.149.201.147:4013 , piece_id=SJUUBXT2KXXZYWAFA7MCNYWCQMWUYMENSCEF5K2OII5BJ6A6ZB3A, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.402376615 (22h12m6.56114236s) [noise=true , address=89.149.201.147:4002 , piece_id=RWIKKLK4SGK5TO7Q7XEOQM7ZMUZTYM5O2ZRMY42AER2W6M6TQWLQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.408793355 (22h12m6.567559089s) [noise=true , address=81.171.14.70:4038 , piece_id=GXO5NY4MWNSE6LP6OQ4L3CGXXOVUMFW253M262XVBRJPYITM4GZQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.411168671 (22h12m6.569934405s) [noise=true , address=81.171.14.70:4027 , piece_id=CIGLJAXFJG6XP2ARGJSF4XDZJ2DUYPFOL3BRC4RJ2WWSEN623C6Q, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.432251313 (22h12m6.591017077s) [noise=true , address=89.149.201.147:4024 , piece_id=C7DXTNTAJZSKWONX3OWSXKNBGVP2MFA64EOOEWXBAWRGU2QIFZIA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.439028192 (22h12m6.597793916s) [noise=true , address=89.149.201.147:4016 , piece_id=G5LDYZMDRZC6H6BDESJCI7QJADOG2PJJ7ZHEFQ247L2OL3ZYLNCQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:39.482959558 (22h12m6.641725292s) [noise=true , address=89.149.201.147:4007 , piece_id=TC6NGHC37ZJJA7377WLBNLOQVFJVLQMKRBXPUMOSF7DZMCAR4XLQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:40.888900213 (22h12m8.047665947s) [noise=true , address=185.167.204.206:4051 , piece_id=XZJTZW2W6CINGDQMZWZKY5H6O32Z4OEV4VD7RJS63LAZK4JX7NPQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:40.908435085 (22h12m8.067200809s) [noise=true , address=185.167.204.206:4063 , piece_id=ANCZTJDYTZGGVB4EXVZPFQV54XCQITWXL2XPH4OYNQKJD7JRACHQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:41.001559908 (22h12m8.160325642s) [noise=true , address=185.167.204.205:4006 , piece_id=7P4PLTESMLLBQCSIF32FOKZF4I47J6VXOUDV5DIHLATYT5JT5JCA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:41.059395351 (22h12m8.218161085s) [noise=true , address=185.167.204.206:4061 , piece_id=XRGY62YTI5VVF5HCSHAGHRENFACV5KYSV2KRACYFWKSUDMQINC2Q, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:41.322411905 (22h12m8.481177639s) [noise=true , address=185.167.204.206:4064 , piece_id=ODNVCCIFT3AEGL6FCVRJDTP6M7OJ4KTYJP4FKNQ2JGYJWR7RHY2Q, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:41.375728041 (22h12m8.534493765s) [noise=true , address=185.167.204.205:4035 , piece_id=EEUBGQRAS2H6GP4JICW4IB2SK7Y3JMFCFYSJO4PKT6KI7GMPSTKA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:41.398510607 (22h12m8.557276341s) [noise=true , address=185.167.204.205:4005 , piece_id=XHZDTH5CINOWD6FTMQ7ZARZ5QUVZMX6AVI7MCWFHSTQRHO4SODSQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:42.019955883 (22h12m9.178721627s) [noise=true , address=185.167.204.205:4016 , piece_id=B5L7QLNK4JEGZF6HV2XUBR25747QKTTUHKZLLYK4S2HLA2HBFNHA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:42.236706023 (22h12m9.395471757s) [noise=true , address=185.167.204.205:4022 , piece_id=5PZRHLYRFWDUWFRVHX7UBEH3ZP6HYEUDD64VHH74O6UQBYQB3RFQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:42.384569050 (22h12m9.543334784s) [noise=true , address=185.167.204.206:4058 , piece_id=PIVE44O3IREXZJLWZJHUKC3X3OFLKKD3HWP5TOSNOR4RHM2Z2LXQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:45.253331334 (22h12m12.412097068s) [noise=true , address=185.167.204.206:4066 , piece_id=53JABB4NV6YOTR5W7P3JFJJTATJBBKN3NQZ6MO2KITDKXW2FBJFA, seg_pos={0 0}, upload=19401]: Done uploading piece. err: <nil>
Aug 26 14:15:45.253376449 (22h12m12.412142183s) [seg_pos={0 0}, upload=19401]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:15:45.253519914 (22h12m12.412285649s) [noise=true , address=185.167.204.206:4039 , piece_id=3BO7DBWTLRDFOXOH64RW5B64TYGY4EIH7EBJCPDNBLHVASXIVWTQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FV1y64fPXx14kCr3Tng2sYqXdsxaPeRJXmNVJLCVKQNkCo3Y9): protocol: expected piece hash; context canceled; EOF
Aug 26 14:15:45.253526888 (22h12m12.412292622s) [noise=true , address=185.167.204.205:4013 , piece_id=JY4H5IXZASBFEPGTC65LSMGVWIB2I2ZOAIY6HLF34I2T3ZQEEBXQ, seg_pos={0 0}, upload=19401]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5): protocol: expected piece hash; context canceled; EOF
Aug 26 14:15:45.253542196 (22h12m12.41230793s) [seg_pos={0 0}, upload=19401]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:15:45.253605688 (22h12m12.412371423s) [upload=19401]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:15:45.253609666 (22h12m12.4123754s) [upload=19401]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:15:45.556770369 (22h12m12.715536103s) [upload=19401]: Done uploading segments...
Aug 26 14:15:45.556790337 (22h12m12.715556071s) [upload=19401]: Upload finished. err: <nil>
Duration: 1m0.002832197s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
27 out of 60 is failed (threshold=3) [..XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.XXX.] duration:
43.753066243s
FAIL (2025-08-26 14:15:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
load=19375]: Uploading piece...
Aug 26 14:13:27.371701385 (22h9m54.530467119s) [noise=true , address=89.149.201.147:4004 , piece_id=LRO5KOLCVBLWMVMNAYQUHQJDVZQI3OBC6EOOFXN3CDNVRNG47YZQ, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.371840982 (22h9m54.530606716s) [noise=true , address=185.167.204.205:4028 , piece_id=FUQ3QG7LU3GMFCX4DH7TQ7UF3HT5UABAQDOOYCI6UWTJIT2YYHWA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372014935 (22h9m54.530780669s) [noise=true , address=81.171.14.70:4029 , piece_id=SEFJXY6ZYVN5XISB5RVTCTO5RGZWX3BCM27QJ3BQGNQ26DWQC7GA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372103154 (22h9m54.530868888s) [noise=true , address=185.167.204.205:4029 , piece_id=H7ZWTLRNMBPEZOOGPW5LZ5TI4QSODTKUCGUT7U22FE5LFAYYTT2Q, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372220929 (22h9m54.530986663s) [noise=true , address=89.149.201.147:4006 , piece_id=6CIBUQJFT22PYPXV25RKEAY7LKLOZXN5QLWEN377V7QIVMHZW2ZQ, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372407877 (22h9m54.531173611s) [noise=true , address=185.167.204.205:4004 , piece_id=N6ZMCAB2JXBGOGC3TINZAZX3DCTO55VBTEYFNXVZ3TYOWXVOPIOA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372425761 (22h9m54.531191495s) [noise=true , address=81.171.14.70:4034 , piece_id=6B7VPJD5YM5GG3ZGWJFVC5QZISMTTJZLHVXJC7NLROBG5TYZLJHQ, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372613139 (22h9m54.531378873s) [noise=true , address=89.149.201.147:4009 , piece_id=3EPVFF5O6QIKMJBX2SWGAVZOU2BHMW5UKFW2MRL23FBNFALGKEYA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372708843 (22h9m54.531474577s) [noise=true , address=81.171.14.70:4039 , piece_id=WHVVNSSD4USI4OYKJ33F6542YSNBRW35U6N6JX7VGE2U7CJSWTVQ, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372964442 (22h9m54.531730176s) [noise=true , address=89.149.201.147:4018 , piece_id=QQOGVWWRDKLJEOURJ6UCZUD4YEQCLHPBT3YVB5WS3UBOY3BBQL6A, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.373229169 (22h9m54.531994903s) [noise=true , address=89.149.201.147:4012 , piece_id=TYH5YFVRBCCQGW6I6YPLRJTZ2DW7TNAEVKCPR3NC2PLDUY64UDLA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.373477394 (22h9m54.532243128s) [noise=true , address=89.149.201.147:4011 , piece_id=ZLLTXJTYIBVPDTCVR5MQTEODUBRKKYRK2GRNEDHOLJI36AC7WGWA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.373698957 (22h9m54.532464691s) [noise=true , address=89.149.201.147:4005 , piece_id=GQMLWS3ZGIV2ID5536Z5Q2PNNRVB3PMZTP4UXM2VCXDM4AEKAQRQ, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:28.194956071 (22h9m55.353721805s) [upload=19375]: Next returned nil segment
Aug 26 14:13:28.194973193 (22h9m55.353738927s) [upload=19375]: Waiting for error group managing segments...
Aug 26 14:13:28.585400859 (22h9m55.744166593s) [noise=true , address=81.171.14.70:4039 , piece_id=WHVVNSSD4USI4OYKJ33F6542YSNBRW35U6N6JX7VGE2U7CJSWTVQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.614198987 (22h9m55.772964721s) [noise=true , address=81.171.14.70:4036 , piece_id=NQKZHNU4H2OJ4XOPK3HAG3LF7BFUABCVPQ4ZHFFTOKQGJMAUWQ7A, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.617316593 (22h9m55.776082327s) [noise=true , address=81.171.14.70:4043 , piece_id=6FW7N5MGHZYPA55RFALGU4RZZA7DMDUBPODNP5ZGVB2J4T5ADOZA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.624591002 (22h9m55.783356736s) [noise=true , address=81.171.14.70:4028 , piece_id=D6SQYTG7WK3A3OOO74ZLVVSBNDNTHZEYJGC6QHDUUHODBD3X33FA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.635081557 (22h9m55.793847281s) [noise=true , address=81.171.14.70:4034 , piece_id=6B7VPJD5YM5GG3ZGWJFVC5QZISMTTJZLHVXJC7NLROBG5TYZLJHQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.635171539 (22h9m55.793937273s) [noise=true , address=81.171.14.70:4029 , piece_id=SEFJXY6ZYVN5XISB5RVTCTO5RGZWX3BCM27QJ3BQGNQ26DWQC7GA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.635667839 (22h9m55.794433573s) [noise=true , address=81.171.14.70:4026 , piece_id=VINXF7ZSTTO7YK4QKPRFTNUXOQLCQQLPJUJBTIEPPIWYZ4LO7TDA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.636051633 (22h9m55.794817397s) [noise=true , address=89.149.201.147:4004 , piece_id=LRO5KOLCVBLWMVMNAYQUHQJDVZQI3OBC6EOOFXN3CDNVRNG47YZQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.646239058 (22h9m55.805004792s) [noise=true , address=89.149.201.147:4005 , piece_id=GQMLWS3ZGIV2ID5536Z5Q2PNNRVB3PMZTP4UXM2VCXDM4AEKAQRQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.646763451 (22h9m55.805529185s) [noise=true , address=89.149.201.147:4006 , piece_id=6CIBUQJFT22PYPXV25RKEAY7LKLOZXN5QLWEN377V7QIVMHZW2ZQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.649116253 (22h9m55.807881987s) [noise=true , address=81.171.14.70:4032 , piece_id=GLTSBFXFKQ5LNYZY4UCZAS34ZJQJ5BLKVSSOG5EGQMCR7MS34NZA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.671823176 (22h9m55.83058891s) [noise=true , address=89.149.201.147:4021 , piece_id=4FLMBTO5K3366JESI3NWQIGFPZTAMCHPGG3IWXVDCJHM3LYOQM7A, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.677253277 (22h9m55.836019011s) [noise=true , address=89.149.201.147:4018 , piece_id=QQOGVWWRDKLJEOURJ6UCZUD4YEQCLHPBT3YVB5WS3UBOY3BBQL6A, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.679392099 (22h9m55.838157823s) [noise=true , address=89.149.201.147:4023 , piece_id=JJ2DCNLKS4I3LXDZJJO6E3LCIWNSGX4QSPJRV7VYAUWDJ7W63TIA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.687417436 (22h9m55.84618317s) [noise=true , address=89.149.201.147:4012 , piece_id=TYH5YFVRBCCQGW6I6YPLRJTZ2DW7TNAEVKCPR3NC2PLDUY64UDLA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.717884678 (22h9m55.876650412s) [noise=true , address=89.149.201.147:4009 , piece_id=3EPVFF5O6QIKMJBX2SWGAVZOU2BHMW5UKFW2MRL23FBNFALGKEYA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.895340244 (22h9m56.054105978s) [noise=true , address=89.149.201.147:4010 , piece_id=S3RCU7BUB337IPBOMTWXFY2GRLK6J6P6RAMDPNKXMCB3WRDXCECQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:29.166868827 (22h9m56.325634561s) [noise=true , address=89.149.201.147:4011 , piece_id=ZLLTXJTYIBVPDTCVR5MQTEODUBRKKYRK2GRNEDHOLJI36AC7WGWA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:29.171513495 (22h9m56.330279229s) [noise=true , address=89.149.201.147:4014 , piece_id=AXNBXAGQ36PCCSZDVKZY66YZ4G7NXTUEMHN6PTWRPBZNCRWAGDHQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:30.132764839 (22h9m57.291530573s) [noise=true , address=185.167.204.205:4004 , piece_id=N6ZMCAB2JXBGOGC3TINZAZX3DCTO55VBTEYFNXVZ3TYOWXVOPIOA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:30.132985631 (22h9m57.291751396s) [noise=true , address=185.167.204.206:4062 , piece_id=NPZQ4GZLQVR3UUSD2T2V2N2VG67PL5YX6GKE44O5WQKJB6O6YFVQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:30.232268418 (22h9m57.391034152s) [noise=true , address=185.167.204.206:4067 , piece_id=47LPT776WPCAJ4Z3BUQ5LCUPBAF562UG7AZWPN4HMJLXBT5QOVHQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:31.108834650 (22h9m58.267600384s) [noise=true , address=185.167.204.206:4058 , piece_id=MVRXX2JV3E62ZS5BZDG3C7JTDBEUYSTYVGEHHFEISZDWLLEACQHQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:31.228834368 (22h9m58.387600092s) [noise=true , address=185.167.204.205:4032 , piece_id=XA6RB6VZUTF6OWLZSKYFH77742QMLIKVJKX4XBCEOCGCKIKZXLTA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:32.217823671 (22h9m59.376589405s) [noise=true , address=185.167.204.205:4029 , piece_id=H7ZWTLRNMBPEZOOGPW5LZ5TI4QSODTKUCGUT7U22FE5LFAYYTT2Q, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:32.470722074 (22h9m59.629487818s) [noise=true , address=185.167.204.205:4002 , piece_id=UBVRUMKJETV7KO3YJF24D7G4QZDAIKJSRYT7XGVDJEPG7OSKODBA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:32.470744166 (22h9m59.629509901s) [seg_pos={0 0}, upload=19375]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:13:32.470818318 (22h9m59.629584052s) [noise=true , address=185.167.204.205:4028 , piece_id=FUQ3QG7LU3GMFCX4DH7TQ7UF3HT5UABAQDOOYCI6UWTJIT2YYHWA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF
Aug 26 14:13:32.470881078 (22h9m59.629646812s) [noise=true , address=185.167.204.205:4003 , piece_id=CP6XERUDAKE23H7IUPNQI2EDQRAHJBIHD73YWDXAKHHBNIDZVBZA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF
Aug 26 14:13:32.470897820 (22h9m59.629663554s) [seg_pos={0 0}, upload=19375]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:13:32.470964318 (22h9m59.629730052s) [upload=19375]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:13:32.470968205 (22h9m59.629733939s) [upload=19375]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:13:32.762003355 (22h9m59.920769089s) [upload=19375]: Done uploading segments...
Aug 26 14:13:32.762022181 (22h9m59.920787905s) [upload=19375]: Upload finished. err: <nil>
Duration: 43.753081762s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
27 out of 60 is failed (threshold=3) [...XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.XXX] duration:
1m0.00304131s
FAIL (2025-08-26 14:14:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
load=19375]: Uploading piece...
Aug 26 14:13:27.371701385 (22h9m54.530467119s) [noise=true , address=89.149.201.147:4004 , piece_id=LRO5KOLCVBLWMVMNAYQUHQJDVZQI3OBC6EOOFXN3CDNVRNG47YZQ, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.371840982 (22h9m54.530606716s) [noise=true , address=185.167.204.205:4028 , piece_id=FUQ3QG7LU3GMFCX4DH7TQ7UF3HT5UABAQDOOYCI6UWTJIT2YYHWA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372014935 (22h9m54.530780669s) [noise=true , address=81.171.14.70:4029 , piece_id=SEFJXY6ZYVN5XISB5RVTCTO5RGZWX3BCM27QJ3BQGNQ26DWQC7GA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372103154 (22h9m54.530868888s) [noise=true , address=185.167.204.205:4029 , piece_id=H7ZWTLRNMBPEZOOGPW5LZ5TI4QSODTKUCGUT7U22FE5LFAYYTT2Q, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372220929 (22h9m54.530986663s) [noise=true , address=89.149.201.147:4006 , piece_id=6CIBUQJFT22PYPXV25RKEAY7LKLOZXN5QLWEN377V7QIVMHZW2ZQ, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372407877 (22h9m54.531173611s) [noise=true , address=185.167.204.205:4004 , piece_id=N6ZMCAB2JXBGOGC3TINZAZX3DCTO55VBTEYFNXVZ3TYOWXVOPIOA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372425761 (22h9m54.531191495s) [noise=true , address=81.171.14.70:4034 , piece_id=6B7VPJD5YM5GG3ZGWJFVC5QZISMTTJZLHVXJC7NLROBG5TYZLJHQ, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372613139 (22h9m54.531378873s) [noise=true , address=89.149.201.147:4009 , piece_id=3EPVFF5O6QIKMJBX2SWGAVZOU2BHMW5UKFW2MRL23FBNFALGKEYA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372708843 (22h9m54.531474577s) [noise=true , address=81.171.14.70:4039 , piece_id=WHVVNSSD4USI4OYKJ33F6542YSNBRW35U6N6JX7VGE2U7CJSWTVQ, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.372964442 (22h9m54.531730176s) [noise=true , address=89.149.201.147:4018 , piece_id=QQOGVWWRDKLJEOURJ6UCZUD4YEQCLHPBT3YVB5WS3UBOY3BBQL6A, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.373229169 (22h9m54.531994903s) [noise=true , address=89.149.201.147:4012 , piece_id=TYH5YFVRBCCQGW6I6YPLRJTZ2DW7TNAEVKCPR3NC2PLDUY64UDLA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.373477394 (22h9m54.532243128s) [noise=true , address=89.149.201.147:4011 , piece_id=ZLLTXJTYIBVPDTCVR5MQTEODUBRKKYRK2GRNEDHOLJI36AC7WGWA, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:27.373698957 (22h9m54.532464691s) [noise=true , address=89.149.201.147:4005 , piece_id=GQMLWS3ZGIV2ID5536Z5Q2PNNRVB3PMZTP4UXM2VCXDM4AEKAQRQ, seg_pos={0 0}, upload=19375]: Uploading piece...
Aug 26 14:13:28.194956071 (22h9m55.353721805s) [upload=19375]: Next returned nil segment
Aug 26 14:13:28.194973193 (22h9m55.353738927s) [upload=19375]: Waiting for error group managing segments...
Aug 26 14:13:28.585400859 (22h9m55.744166593s) [noise=true , address=81.171.14.70:4039 , piece_id=WHVVNSSD4USI4OYKJ33F6542YSNBRW35U6N6JX7VGE2U7CJSWTVQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.614198987 (22h9m55.772964721s) [noise=true , address=81.171.14.70:4036 , piece_id=NQKZHNU4H2OJ4XOPK3HAG3LF7BFUABCVPQ4ZHFFTOKQGJMAUWQ7A, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.617316593 (22h9m55.776082327s) [noise=true , address=81.171.14.70:4043 , piece_id=6FW7N5MGHZYPA55RFALGU4RZZA7DMDUBPODNP5ZGVB2J4T5ADOZA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.624591002 (22h9m55.783356736s) [noise=true , address=81.171.14.70:4028 , piece_id=D6SQYTG7WK3A3OOO74ZLVVSBNDNTHZEYJGC6QHDUUHODBD3X33FA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.635081557 (22h9m55.793847281s) [noise=true , address=81.171.14.70:4034 , piece_id=6B7VPJD5YM5GG3ZGWJFVC5QZISMTTJZLHVXJC7NLROBG5TYZLJHQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.635171539 (22h9m55.793937273s) [noise=true , address=81.171.14.70:4029 , piece_id=SEFJXY6ZYVN5XISB5RVTCTO5RGZWX3BCM27QJ3BQGNQ26DWQC7GA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.635667839 (22h9m55.794433573s) [noise=true , address=81.171.14.70:4026 , piece_id=VINXF7ZSTTO7YK4QKPRFTNUXOQLCQQLPJUJBTIEPPIWYZ4LO7TDA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.636051633 (22h9m55.794817397s) [noise=true , address=89.149.201.147:4004 , piece_id=LRO5KOLCVBLWMVMNAYQUHQJDVZQI3OBC6EOOFXN3CDNVRNG47YZQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.646239058 (22h9m55.805004792s) [noise=true , address=89.149.201.147:4005 , piece_id=GQMLWS3ZGIV2ID5536Z5Q2PNNRVB3PMZTP4UXM2VCXDM4AEKAQRQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.646763451 (22h9m55.805529185s) [noise=true , address=89.149.201.147:4006 , piece_id=6CIBUQJFT22PYPXV25RKEAY7LKLOZXN5QLWEN377V7QIVMHZW2ZQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.649116253 (22h9m55.807881987s) [noise=true , address=81.171.14.70:4032 , piece_id=GLTSBFXFKQ5LNYZY4UCZAS34ZJQJ5BLKVSSOG5EGQMCR7MS34NZA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.671823176 (22h9m55.83058891s) [noise=true , address=89.149.201.147:4021 , piece_id=4FLMBTO5K3366JESI3NWQIGFPZTAMCHPGG3IWXVDCJHM3LYOQM7A, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.677253277 (22h9m55.836019011s) [noise=true , address=89.149.201.147:4018 , piece_id=QQOGVWWRDKLJEOURJ6UCZUD4YEQCLHPBT3YVB5WS3UBOY3BBQL6A, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.679392099 (22h9m55.838157823s) [noise=true , address=89.149.201.147:4023 , piece_id=JJ2DCNLKS4I3LXDZJJO6E3LCIWNSGX4QSPJRV7VYAUWDJ7W63TIA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.687417436 (22h9m55.84618317s) [noise=true , address=89.149.201.147:4012 , piece_id=TYH5YFVRBCCQGW6I6YPLRJTZ2DW7TNAEVKCPR3NC2PLDUY64UDLA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.717884678 (22h9m55.876650412s) [noise=true , address=89.149.201.147:4009 , piece_id=3EPVFF5O6QIKMJBX2SWGAVZOU2BHMW5UKFW2MRL23FBNFALGKEYA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:28.895340244 (22h9m56.054105978s) [noise=true , address=89.149.201.147:4010 , piece_id=S3RCU7BUB337IPBOMTWXFY2GRLK6J6P6RAMDPNKXMCB3WRDXCECQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:29.166868827 (22h9m56.325634561s) [noise=true , address=89.149.201.147:4011 , piece_id=ZLLTXJTYIBVPDTCVR5MQTEODUBRKKYRK2GRNEDHOLJI36AC7WGWA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:29.171513495 (22h9m56.330279229s) [noise=true , address=89.149.201.147:4014 , piece_id=AXNBXAGQ36PCCSZDVKZY66YZ4G7NXTUEMHN6PTWRPBZNCRWAGDHQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:30.132764839 (22h9m57.291530573s) [noise=true , address=185.167.204.205:4004 , piece_id=N6ZMCAB2JXBGOGC3TINZAZX3DCTO55VBTEYFNXVZ3TYOWXVOPIOA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:30.132985631 (22h9m57.291751396s) [noise=true , address=185.167.204.206:4062 , piece_id=NPZQ4GZLQVR3UUSD2T2V2N2VG67PL5YX6GKE44O5WQKJB6O6YFVQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:30.232268418 (22h9m57.391034152s) [noise=true , address=185.167.204.206:4067 , piece_id=47LPT776WPCAJ4Z3BUQ5LCUPBAF562UG7AZWPN4HMJLXBT5QOVHQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:31.108834650 (22h9m58.267600384s) [noise=true , address=185.167.204.206:4058 , piece_id=MVRXX2JV3E62ZS5BZDG3C7JTDBEUYSTYVGEHHFEISZDWLLEACQHQ, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:31.228834368 (22h9m58.387600092s) [noise=true , address=185.167.204.205:4032 , piece_id=XA6RB6VZUTF6OWLZSKYFH77742QMLIKVJKX4XBCEOCGCKIKZXLTA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:32.217823671 (22h9m59.376589405s) [noise=true , address=185.167.204.205:4029 , piece_id=H7ZWTLRNMBPEZOOGPW5LZ5TI4QSODTKUCGUT7U22FE5LFAYYTT2Q, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:32.470722074 (22h9m59.629487818s) [noise=true , address=185.167.204.205:4002 , piece_id=UBVRUMKJETV7KO3YJF24D7G4QZDAIKJSRYT7XGVDJEPG7OSKODBA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: <nil>
Aug 26 14:13:32.470744166 (22h9m59.629509901s) [seg_pos={0 0}, upload=19375]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:13:32.470818318 (22h9m59.629584052s) [noise=true , address=185.167.204.205:4028 , piece_id=FUQ3QG7LU3GMFCX4DH7TQ7UF3HT5UABAQDOOYCI6UWTJIT2YYHWA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF
Aug 26 14:13:32.470881078 (22h9m59.629646812s) [noise=true , address=185.167.204.205:4003 , piece_id=CP6XERUDAKE23H7IUPNQI2EDQRAHJBIHD73YWDXAKHHBNIDZVBZA, seg_pos={0 0}, upload=19375]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF
Aug 26 14:13:32.470897820 (22h9m59.629663554s) [seg_pos={0 0}, upload=19375]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:13:32.470964318 (22h9m59.629730052s) [upload=19375]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:13:32.470968205 (22h9m59.629733939s) [upload=19375]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:13:32.762003355 (22h9m59.920769089s) [upload=19375]: Done uploading segments...
Aug 26 14:13:32.762022181 (22h9m59.920787905s) [upload=19375]: Upload finished. err: <nil>
Duration: 1m0.003061619s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
26 out of 60 is failed (threshold=3) [....XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.XX] duration:
1m0.002823057s
FAIL (2025-08-26 14:13:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.380059323 (22h8m50.538825057s) [noise=true , address=89.149.201.147:4009 , piece_id=TEL3ISLXTTQVPVZDZL3AJU3XOJTOLLPXIS7BUW3V734O7MZNR55Q, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.380195253 (22h8m50.538960987s) [noise=true , address=89.149.201.147:4019 , piece_id=3MQTE3LINIK3ACTAG765WOLIJA4QNQKQ77NAY6LSEREJNIVRW6TQ, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.380309272 (22h8m50.539075006s) [noise=true , address=185.167.204.205:4029 , piece_id=COTKYSPF3PVPSA2P7ZN6TAIEJKOM2SUWPZWMILCPTBE2IQXKMFVA, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.380535655 (22h8m50.539301389s) [noise=true , address=185.167.204.206:4066 , piece_id=VVTLPZYOGC7NKTCETIVX6RSZL6JHO5E5HJ5TWX6WCQ2OYHRDPOUA, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.380607853 (22h8m50.539373598s) [noise=true , address=81.171.14.70:4043 , piece_id=WCVURKSEALGZ77CYA43XNU2IK46BD37LAZ4YD3DAYUGIFORYPG6A, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.380863031 (22h8m50.539628755s) [noise=true , address=81.171.14.70:4047 , piece_id=HRPQWYLIOJQBR4EOEXC3XSI6WSGO6EUAB6MASDZKGYFUO4FXNISQ, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.380884242 (22h8m50.539649976s) [noise=true , address=89.149.201.147:4005 , piece_id=YN4OBL43M5Y2B2PGNIN2YZDPMM7M3VY3VPTRC76NLALLU3MQIJTQ, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.381061351 (22h8m50.539827085s) [noise=true , address=81.171.14.70:4029 , piece_id=NRHNAAU5Q4D6FWLBH2FSAMXRN32EAOMMQVHHZIMCYEQGEBXEUXEQ, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.381212280 (22h8m50.539978014s) [noise=true , address=185.167.204.206:4072 , piece_id=SUFQKWI6D73CULBD4NGEK3SGFI56FWZBNBT7IFZ42D75BLFIJ6XA, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.381309586 (22h8m50.54007532s) [noise=true , address=185.167.204.205:4019 , piece_id=37WYHXE5XD6LYOWDEXZNXTR2VG44PCE5D4OI4HHPVWC6CTRBPRXQ, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.381524537 (22h8m50.540290271s) [noise=true , address=81.171.14.70:4039 , piece_id=GJFMO4GZMQZXKBMRMBJSSRGW2BNVAQKSVQA2ESBTLZV2QOPGHHQQ, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.381534407 (22h8m50.540300131s) [noise=true , address=185.167.204.205:4023 , piece_id=KOIF75OGS5Q6EHA4Y4H7YZWHCJ6PF2SSYYVFNUR4FUULFJUWVAIA, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:23.381718688 (22h8m50.540484432s) [noise=true , address=81.171.14.70:4040 , piece_id=RUVMN54Q3YONYR72GXN45KL7WKN7C6LY2RD7PA2Z4JBAP4DZA2VQ, seg_pos={0 0}, upload=19360]: Uploading piece...
Aug 26 14:12:24.205278308 (22h8m51.364044042s) [upload=19360]: Next returned nil segment
Aug 26 14:12:24.205297365 (22h8m51.364063099s) [upload=19360]: Waiting for error group managing segments...
Aug 26 14:12:24.576850572 (22h8m51.735616306s) [noise=true , address=81.171.14.70:4039 , piece_id=GJFMO4GZMQZXKBMRMBJSSRGW2BNVAQKSVQA2ESBTLZV2QOPGHHQQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.595632192 (22h8m51.754397926s) [noise=true , address=81.171.14.70:4036 , piece_id=RCSKPL5NCHWMDXSDPA272UYM7SAO7B2JS54RCPSJCIGWNO3ZLC4Q, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.605483104 (22h8m51.764248828s) [noise=true , address=81.171.14.70:4033 , piece_id=7LUP7DN7SYKJU2CNVJUCETQM4CHT4AZWQWIY5U5S63SW2I5FPN6Q, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.610395073 (22h8m51.769160807s) [noise=true , address=81.171.14.70:4029 , piece_id=NRHNAAU5Q4D6FWLBH2FSAMXRN32EAOMMQVHHZIMCYEQGEBXEUXEQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.646517296 (22h8m51.80528303s) [noise=true , address=81.171.14.70:4043 , piece_id=WCVURKSEALGZ77CYA43XNU2IK46BD37LAZ4YD3DAYUGIFORYPG6A, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.648932186 (22h8m51.80769792s) [noise=true , address=81.171.14.70:4047 , piece_id=HRPQWYLIOJQBR4EOEXC3XSI6WSGO6EUAB6MASDZKGYFUO4FXNISQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.659051641 (22h8m51.817817375s) [noise=true , address=89.149.201.147:4005 , piece_id=YN4OBL43M5Y2B2PGNIN2YZDPMM7M3VY3VPTRC76NLALLU3MQIJTQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.659268867 (22h8m51.818034601s) [noise=true , address=81.171.14.70:4040 , piece_id=RUVMN54Q3YONYR72GXN45KL7WKN7C6LY2RD7PA2Z4JBAP4DZA2VQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.660262147 (22h8m51.819027871s) [noise=true , address=89.149.201.147:4019 , piece_id=3MQTE3LINIK3ACTAG765WOLIJA4QNQKQ77NAY6LSEREJNIVRW6TQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.663424438 (22h8m51.822190172s) [noise=true , address=89.149.201.147:4002 , piece_id=NLZKBWY652TNC5ODIYMDFVPBV4MKT4JTB2VQYZAKR6PT5OSSU2HA, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.670869876 (22h8m51.82963561s) [noise=true , address=81.171.14.70:4046 , piece_id=MZBSV3LCNCKO6TEDMWQQZG35DU3GNQNDQ7HKY4T47PWX3DKDQLDQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.685273489 (22h8m51.844039223s) [noise=true , address=81.171.14.70:4026 , piece_id=ETR65IRI4NB7AQ54D3FDUR5BDVV5DRDGEFTOXGEXKL5XJW4GBXMA, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.696828570 (22h8m51.855594294s) [noise=true , address=81.171.14.70:4041 , piece_id=QQZ27GC4GSOEUCZJ24KCQTWC5NB2EOBAIBE77J5QXSVSLQ3GG55Q, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.697974863 (22h8m51.856740597s) [noise=true , address=89.149.201.147:4017 , piece_id=U4IPRMKTRDWIRPENUZQM2MXKVKR2BJTEWS7JH5JZYT2VI2SJUDHQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.708128974 (22h8m51.866894698s) [noise=true , address=89.149.201.147:4015 , piece_id=FHTWV2J3BABECUDSYHX4M6TJMB5JHRM4AMHXW6W4FJBBFZMYSAVQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.742670423 (22h8m51.901436157s) [noise=true , address=89.149.201.147:4009 , piece_id=TEL3ISLXTTQVPVZDZL3AJU3XOJTOLLPXIS7BUW3V734O7MZNR55Q, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:24.941677068 (22h8m52.100442832s) [noise=true , address=81.171.14.70:4038 , piece_id=CF2DUEIPI4PDS6ENPY43QRJSJGEBOVBMGHTIXE2CR2QE7AAGM32Q, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:25.133370481 (22h8m52.292136265s) [noise=true , address=89.149.201.147:4001 , piece_id=7NY3ZVT6EQSMLTAADL2RSGSZ7PNTVYR7RZDUHMYQQBLEQEE6ECRQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:26.073385105 (22h8m53.232150839s) [noise=true , address=185.167.204.206:4072 , piece_id=SUFQKWI6D73CULBD4NGEK3SGFI56FWZBNBT7IFZ42D75BLFIJ6XA, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:26.082836751 (22h8m53.241602485s) [noise=true , address=185.167.204.205:4023 , piece_id=KOIF75OGS5Q6EHA4Y4H7YZWHCJ6PF2SSYYVFNUR4FUULFJUWVAIA, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:26.098897064 (22h8m53.257662798s) [noise=true , address=185.167.204.205:4010 , piece_id=72YQ7QTDFBCGKAII4HCQ4OHBVVLX3KTQ5CUW2AH7SGLJKO2W6UGA, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:26.389859865 (22h8m53.548625599s) [noise=true , address=185.167.204.205:4019 , piece_id=37WYHXE5XD6LYOWDEXZNXTR2VG44PCE5D4OI4HHPVWC6CTRBPRXQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:26.633996600 (22h8m53.792762324s) [noise=true , address=185.167.204.206:4066 , piece_id=VVTLPZYOGC7NKTCETIVX6RSZL6JHO5E5HJ5TWX6WCQ2OYHRDPOUA, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:27.262867877 (22h8m54.421633611s) [noise=true , address=185.167.204.206:4038 , piece_id=2PCGX6P7P2YZMGLUIK3DAV4RDYGW42VGG2LED3YGXWTVKMN5L2DA, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:28.087981008 (22h8m55.246746742s) [noise=true , address=185.167.204.206:4054 , piece_id=TQFUUB6TWAQMY2MG45OM32NI7FQMH6CL5D5XCUY5LWBXDSHPCZMA, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:28.625270376 (22h8m55.7840361s) [noise=true , address=185.167.204.205:4036 , piece_id=APTLN3NP7HLEOWAK7FEUP4ORNCFYWSCPCXTLQ6UHWUH2PY67MPJQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: <nil>
Aug 26 14:12:28.625295354 (22h8m55.784061088s) [seg_pos={0 0}, upload=19360]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:12:28.625396488 (22h8m55.784162222s) [noise=true , address=185.167.204.206:4037 , piece_id=6B3ZCRVFXRCGVGYBZNE5ZVZPOLBCL46LEEEIWFFVTOIRCIZAG4WQ, seg_pos={0 0}, upload=19360]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R): protocol: expected piece hash; context canceled; EOF
Aug 26 14:12:28.625529252 (22h8m55.784294986s) [noise=true , address=185.167.204.205:4029 , piece_id=COTKYSPF3PVPSA2P7ZN6TAIEJKOM2SUWPZWMILCPTBE2IQXKMFVA, seg_pos={0 0}, upload=19360]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn): protocol: context canceled; context canceled
Aug 26 14:12:28.625549230 (22h8m55.784314964s) [seg_pos={0 0}, upload=19360]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:12:28.625625075 (22h8m55.784390819s) [upload=19360]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:12:28.625631558 (22h8m55.784397302s) [upload=19360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:12:28.890477000 (22h8m56.049242725s) [upload=19360]: Done uploading segments...
Aug 26 14:12:28.890496829 (22h8m56.049262563s) [upload=19360]: Upload finished. err: <nil>
Duration: 1m0.002838316s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
25 out of 60 is failed (threshold=3) [.....XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.X] duration:
1m0.003959254s
FAIL (2025-08-26 14:12:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
oad=19346]: Uploading piece...
Aug 26 14:11:23.159176801 (22h7m50.317942535s) [noise=true , address=81.171.14.70:4033 , piece_id=MCHGP6GBD2RBTJAHYDK7PQLS36YL7FL7VXCQQJUNJAELCLKIWVKA, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.159385660 (22h7m50.318151394s) [noise=true , address=185.167.204.205:4001 , piece_id=M7OLO3IPE47LL6Q7H6C3A3UDD7HMSVNPXA64DPEJ23EG7MBIL3WA, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.159690133 (22h7m50.318455867s) [noise=true , address=81.171.14.70:4036 , piece_id=KAEEKMJKNH3BJUJS4KMAFTQ6LXDZOLKEKFOUUCWXR25WDR2HDLYA, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.159941585 (22h7m50.318707319s) [noise=true , address=185.167.204.206:4066 , piece_id=3UQP6Z4UVFVPO6ICXGEBKOJ3ICQUGCT7E7VM763FYA4SSPFAW5UQ, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.160161125 (22h7m50.318926859s) [noise=true , address=185.167.204.205:4035 , piece_id=L2VW3MGTK36JIMWVSUK5MLDQBIJ4AU4JDOH2BNOLUMUJTGL2XGUA, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.160370475 (22h7m50.319136209s) [noise=true , address=185.167.204.205:4003 , piece_id=GLXWVP5T7HO6YCTH7ZDGQOM7B6NTP66X6MOTCN32RUMFA24MFGCQ, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.160493761 (22h7m50.319259495s) [noise=true , address=185.167.204.205:4019 , piece_id=LCMNRKILXOW3L7A7APUOO6KQH376BQFMLYCAP4IDSZ3I6WL7CM7A, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.160744280 (22h7m50.319510014s) [noise=true , address=81.171.14.70:4031 , piece_id=ACOLA3QI3JU4O4HTEHNX3TM7DZJYLTCI3V2DHVL2Z7BKCVCFL7VA, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.160845013 (22h7m50.319610738s) [noise=true , address=185.167.204.206:4057 , piece_id=2UBMFFEVXN7UOBIWLIALFZ4VOPUJ67UEYXI3N4KOVD4JFM5KPIVA, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.161107225 (22h7m50.319872959s) [noise=true , address=89.149.201.147:4019 , piece_id=LKSMG5HB2SR63SBJQI3O7BPJAW27I54KV5TURDCXVRE5NB27PPSA, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.161257443 (22h7m50.320023177s) [noise=true , address=81.171.14.70:4039 , piece_id=645OMQNPLVW77LPXVLFSD3JZELC6SJ62EARPVMZY4YCLNQFMOKSQ, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.161513152 (22h7m50.320278886s) [noise=true , address=81.171.14.70:4046 , piece_id=LD2YE2VSNYPL4S5YU5IYRFWQPHGJIXSHKINDBLMSJBBUZ7L5RBJA, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.161562045 (22h7m50.320327779s) [noise=true , address=185.167.204.206:4064 , piece_id=GWVI3TIUTG45IGGXK6LVK3U2WZNGAK6OMBF2TABLZL4XAYBR45YQ, seg_pos={0 0}, upload=19346]: Uploading piece...
Aug 26 14:11:23.996539814 (22h7m51.155305578s) [upload=19346]: Next returned nil segment
Aug 26 14:11:23.996563239 (22h7m51.155329023s) [upload=19346]: Waiting for error group managing segments...
Aug 26 14:11:24.367089512 (22h7m51.525855246s) [noise=true , address=81.171.14.70:4039 , piece_id=645OMQNPLVW77LPXVLFSD3JZELC6SJ62EARPVMZY4YCLNQFMOKSQ, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.367596532 (22h7m51.526362266s) [noise=true , address=81.171.14.70:4046 , piece_id=LD2YE2VSNYPL4S5YU5IYRFWQPHGJIXSHKINDBLMSJBBUZ7L5RBJA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.397313818 (22h7m51.556079552s) [noise=true , address=81.171.14.70:4032 , piece_id=MFCKNIAU4WYPDZTVYEISEFRGB4CHFEVOHQLHY4TI3EFZ3LJMPGWA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.411795169 (22h7m51.570560903s) [noise=true , address=89.149.201.147:4014 , piece_id=42YXE4KNI7X7XE7FPIFSZMJIH3A2FWEBSEB7NLT6A4YVRFFBZNRQ, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.417837361 (22h7m51.576603095s) [noise=true , address=89.149.201.147:4003 , piece_id=OUNJ4GELQK7SUMUPWXOZ4TI4RQ7MLB6WTO47RX56X7F5IGL5WCHQ, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.421071831 (22h7m51.579837565s) [noise=true , address=89.149.201.147:4007 , piece_id=KVLKUN4SI46KAWHOBDDTBQBEWWDVU3ESMDKOK3F23DE6J3DSM54A, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.422884190 (22h7m51.581649924s) [noise=true , address=89.149.201.147:4019 , piece_id=LKSMG5HB2SR63SBJQI3O7BPJAW27I54KV5TURDCXVRE5NB27PPSA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.431054764 (22h7m51.589820498s) [noise=true , address=89.149.201.147:4022 , piece_id=BPFSAZBOYEKV2AVQYDNXHCSWHXCAO2DZ7XWAUOM3F7CCLYXVBS7Q, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.442628592 (22h7m51.601394326s) [noise=true , address=81.171.14.70:4041 , piece_id=7XMCCZRYG4BZJBAW767TRIB2B6677PSLKIQQOKY4FU4M42QDZHAA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.446554765 (22h7m51.605320499s) [noise=true , address=81.171.14.70:4030 , piece_id=XX3IHWP3XR5DDEDR23775Y7BTXQ3QO5J3NNCN5C4BGJGI6MFRWRQ, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.448145989 (22h7m51.606911723s) [noise=true , address=81.171.14.70:4033 , piece_id=MCHGP6GBD2RBTJAHYDK7PQLS36YL7FL7VXCQQJUNJAELCLKIWVKA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.451750277 (22h7m51.610516011s) [noise=true , address=81.171.14.70:4031 , piece_id=ACOLA3QI3JU4O4HTEHNX3TM7DZJYLTCI3V2DHVL2Z7BKCVCFL7VA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.473536567 (22h7m51.632302301s) [noise=true , address=89.149.201.147:4015 , piece_id=KHWKPNFZHGZDVMD464ZWNHBLZHLM7R6JHGNUJ6ZW6ROOV6V2KTTQ, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:24.862469291 (22h7m52.021235026s) [noise=true , address=81.171.14.70:4036 , piece_id=KAEEKMJKNH3BJUJS4KMAFTQ6LXDZOLKEKFOUUCWXR25WDR2HDLYA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:25.841260990 (22h7m53.000026724s) [noise=true , address=185.167.204.206:4066 , piece_id=3UQP6Z4UVFVPO6ICXGEBKOJ3ICQUGCT7E7VM763FYA4SSPFAW5UQ, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:25.864660176 (22h7m53.02342591s) [noise=true , address=185.167.204.205:4013 , piece_id=J2M7V2T5UPNB73K36JSMO4HZDSQRA25QZV7KY7E67UT6FYNOCSSQ, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:25.878853617 (22h7m53.037619351s) [noise=true , address=185.167.204.206:4050 , piece_id=GPM2EOLIVR76OZHRJKNND674EHHQNUXJZIZDK2G2ORIZSTZTQ5EA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:26.028932334 (22h7m53.187698068s) [noise=true , address=185.167.204.205:4007 , piece_id=CPFLWNDGXRNQZTHO34YMTVM5YFL432HQA3QJPRTSMIIF722MQJ5A, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:26.334117721 (22h7m53.492883455s) [noise=true , address=185.167.204.206:4044 , piece_id=WASYPT26XXZMRGECOQNZCTY7CRMHGGFQUH2SKQWYCJOCJTZUZ6WQ, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:26.479166865 (22h7m53.637932609s) [noise=true , address=185.167.204.205:4035 , piece_id=L2VW3MGTK36JIMWVSUK5MLDQBIJ4AU4JDOH2BNOLUMUJTGL2XGUA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:26.511363436 (22h7m53.67012917s) [noise=true , address=185.167.204.206:4064 , piece_id=GWVI3TIUTG45IGGXK6LVK3U2WZNGAK6OMBF2TABLZL4XAYBR45YQ, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:26.807527129 (22h7m53.966292863s) [noise=true , address=185.167.204.205:4019 , piece_id=LCMNRKILXOW3L7A7APUOO6KQH376BQFMLYCAP4IDSZ3I6WL7CM7A, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:26.962216732 (22h7m54.120982466s) [noise=true , address=185.167.204.206:4057 , piece_id=2UBMFFEVXN7UOBIWLIALFZ4VOPUJ67UEYXI3N4KOVD4JFM5KPIVA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:27.022974226 (22h7m54.18173996s) [noise=true , address=185.167.204.206:4047 , piece_id=FTWQBFPICTTWABI77WLPN3U2CDVTFTTKKLVY7KOQKGVDASPWDFBA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:27.452236424 (22h7m54.611002158s) [noise=true , address=185.167.204.205:4001 , piece_id=M7OLO3IPE47LL6Q7H6C3A3UDD7HMSVNPXA64DPEJ23EG7MBIL3WA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:30.304888511 (22h7m57.463654255s) [noise=true , address=185.167.204.205:4003 , piece_id=GLXWVP5T7HO6YCTH7ZDGQOM7B6NTP66X6MOTCN32RUMFA24MFGCQ, seg_pos={0 0}, upload=19346]: Done uploading piece. err: <nil>
Aug 26 14:11:30.304949157 (22h7m57.463714911s) [seg_pos={0 0}, upload=19346]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:11:30.305192893 (22h7m57.463958637s) [noise=true , address=185.167.204.205:4002 , piece_id=J5HWLE4RZVYQL5676JZJRFMIVAGBV5WEJPUH5LT7ODYT7L3PUUYA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3): protocol: expected piece hash; context canceled; EOF
Aug 26 14:11:30.305267365 (22h7m57.464033099s) [noise=true , address=185.167.204.205:4030 , piece_id=R5TJ5X7553BZEDMSUKFEP2FZFC4NUXYYPKXZNOSWNSDGGS7GDCGA, seg_pos={0 0}, upload=19346]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk): protocol: expected piece hash; context canceled; EOF
Aug 26 14:11:30.305319675 (22h7m57.464085409s) [seg_pos={0 0}, upload=19346]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:11:30.305427291 (22h7m57.464193035s) [upload=19346]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:11:30.305435337 (22h7m57.464201071s) [upload=19346]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:11:30.602225520 (22h7m57.760991254s) [upload=19346]: Done uploading segments...
Aug 26 14:11:30.602246410 (22h7m57.761012164s) [upload=19346]: Upload finished. err: <nil>
Duration: 1m0.003984781s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
24 out of 60 is failed (threshold=3) [......XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX.] duration:
35.409626365s
FAIL (2025-08-26 14:10:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.749088434 (22h5m45.907854168s) [noise=true , address=81.171.14.70:4031 , piece_id=SQUB4XE5CIVJDBJYU4IJLTD6YELBI3A2ALCXHMFX2UEBGDHJUE5Q, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.749163638 (22h5m45.907929372s) [noise=true , address=89.149.201.147:4016 , piece_id=AKRPLGFRANOBDWYTYU7JT4LYJBP5CXRBB23ULIOXTMF35F5JEVYA, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.749932008 (22h5m45.908697742s) [noise=true , address=81.171.14.70:4044 , piece_id=3CU4NWO5735WGJ3DL4ZG2Z2UFNHCDX4LMJJVGW6ORZ5IH53OPLGA, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.749978556 (22h5m45.908744291s) [noise=true , address=185.167.204.206:4052 , piece_id=J5FCMYUMEVJDVAKLGQ2GTRR2NOM22QBUZEMIQNYFMBEHPQOLJL4A, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.750295353 (22h5m45.909061087s) [noise=true , address=185.167.204.206:4050 , piece_id=L2U45TLX64H57FTUCI4ZDHL6OMJQVPACFRWSZFDYOT7VVK77WC2Q, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.750608221 (22h5m45.909373955s) [noise=true , address=185.167.204.206:4051 , piece_id=Z7WE726HPEHOWH2VPTLSKFRTBAVNOT4CMCXFGE5LYZHT2JSQ6ZDA, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.751315535 (22h5m45.910081289s) [noise=true , address=89.149.201.147:4010 , piece_id=TMVNRLAL4KVHLLSUGMOWUC4FUDQ7ODGCH2KNC7HAK4ZAZK72L27Q, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.751577837 (22h5m45.910343571s) [noise=true , address=185.167.204.205:4036 , piece_id=E5ZXJFL3KMMDLBZTUIN3EYURYPBL3HMQC2PGBV5ENIRMFAUXWWZQ, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.752305619 (22h5m45.911071353s) [noise=true , address=89.149.201.147:4001 , piece_id=VG5FSIJUPKLIFPDAGMCHY3P75YNFLVN4NGQRNYL2OUHQADFSAKZQ, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.752667262 (22h5m45.911432996s) [noise=true , address=89.149.201.147:4005 , piece_id=ZQNVOJP2XMUS4SL6RYFO7EF4AQKA534U57W56KIPKEJ7D73YVV2Q, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.753531114 (22h5m45.912296848s) [noise=true , address=185.167.204.205:4023 , piece_id=HPC2WTDR3D67KWZ3B22OVE4UQPRQO6KF65GXHC4BI2JSV4O2JYQA, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.754099492 (22h5m45.912865226s) [noise=true , address=185.167.204.205:4013 , piece_id=ALJFONWED5GKYL4H73IBM2UY4A6AT3ISX7EHHRRZMPCOVHD6CLLA, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.754858564 (22h5m45.913624298s) [noise=true , address=185.167.204.205:4031 , piece_id=3TLXLCTQNLDCV46RWB2NKBFM525QLFUFEYVTTNEPFVEZB7TZFWNQ, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:19.604061384 (22h5m46.762827118s) [upload=19313]: Next returned nil segment
Aug 26 14:09:19.604078477 (22h5m46.762844211s) [upload=19313]: Waiting for error group managing segments...
Aug 26 14:09:20.005941848 (22h5m47.164707582s) [noise=true , address=81.171.14.70:4031 , piece_id=SQUB4XE5CIVJDBJYU4IJLTD6YELBI3A2ALCXHMFX2UEBGDHJUE5Q, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.008456600 (22h5m47.167222324s) [noise=true , address=81.171.14.70:4029 , piece_id=KMJS2SNDK6YYNE2VPBUFGGPLZPWRL76NH2ZABLML3Z3R6YNWROZQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.023690511 (22h5m47.182456245s) [noise=true , address=89.149.201.147:4015 , piece_id=FS5OSFTICBMWWSUBL3EMF5SWGYDLFZNFYRNYL7BMQIPKH6DPS2GQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.024460285 (22h5m47.183226019s) [noise=true , address=89.149.201.147:4016 , piece_id=AKRPLGFRANOBDWYTYU7JT4LYJBP5CXRBB23ULIOXTMF35F5JEVYA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.039310341 (22h5m47.198076075s) [noise=true , address=81.171.14.70:4030 , piece_id=LKGISC6VM2ZL52A5CFSUYUBYEC77JIZO6W36L462EOYG32A7OEBA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.044724633 (22h5m47.203490367s) [noise=true , address=89.149.201.147:4010 , piece_id=TMVNRLAL4KVHLLSUGMOWUC4FUDQ7ODGCH2KNC7HAK4ZAZK72L27Q, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.073161499 (22h5m47.231927233s) [noise=true , address=89.149.201.147:4005 , piece_id=ZQNVOJP2XMUS4SL6RYFO7EF4AQKA534U57W56KIPKEJ7D73YVV2Q, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.101835819 (22h5m47.260601553s) [noise=true , address=89.149.201.147:4001 , piece_id=VG5FSIJUPKLIFPDAGMCHY3P75YNFLVN4NGQRNYL2OUHQADFSAKZQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.156959202 (22h5m47.315724926s) [noise=true , address=81.171.14.70:4044 , piece_id=3CU4NWO5735WGJ3DL4ZG2Z2UFNHCDX4LMJJVGW6ORZ5IH53OPLGA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.444834369 (22h5m48.603600103s) [noise=true , address=185.167.204.205:4007 , piece_id=ERNGD3BYBLMBFOSYGQK3RDDMOEVEOVQZ2INDXHNSPM5ZYA66UM2A, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.476827429 (22h5m48.635593153s) [noise=true , address=185.167.204.205:4013 , piece_id=ALJFONWED5GKYL4H73IBM2UY4A6AT3ISX7EHHRRZMPCOVHD6CLLA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.498283377 (22h5m48.657049111s) [noise=true , address=185.167.204.206:4065 , piece_id=KGCLCNEX4KTZI7W4KZMAGJUBEMURP2IUXC6Z2LVT6W6UY7BNSCYQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.526327351 (22h5m48.685093085s) [noise=true , address=185.167.204.205:4030 , piece_id=RWPTEMVBKSCFIZJANNGK2F72LGIOC2KJD5532B2YASQQCS4H5C4A, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.591982327 (22h5m48.750748091s) [noise=true , address=185.167.204.205:4031 , piece_id=3TLXLCTQNLDCV46RWB2NKBFM525QLFUFEYVTTNEPFVEZB7TZFWNQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.702846615 (22h5m48.861612349s) [noise=true , address=185.167.204.206:4051 , piece_id=Z7WE726HPEHOWH2VPTLSKFRTBAVNOT4CMCXFGE5LYZHT2JSQ6ZDA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.722853249 (22h5m48.881618983s) [noise=true , address=185.167.204.206:4068 , piece_id=4MIKFJVLPF5K676LC2EC4T32OE44FRLLDP2BZFPI757YM57AQ2QQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.765723986 (22h5m48.92448972s) [noise=true , address=185.167.204.205:4032 , piece_id=ZTTPX3LROGPKIZN7BFCK5SJT26I53AZIL2GDNMRP6ZZLRH6A253A, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.986191178 (22h5m49.144956912s) [noise=true , address=185.167.204.205:4036 , piece_id=E5ZXJFL3KMMDLBZTUIN3EYURYPBL3HMQC2PGBV5ENIRMFAUXWWZQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:22.438572337 (22h5m49.597338061s) [noise=true , address=185.167.204.206:4052 , piece_id=J5FCMYUMEVJDVAKLGQ2GTRR2NOM22QBUZEMIQNYFMBEHPQOLJL4A, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:22.846086650 (22h5m50.004852384s) [noise=true , address=185.167.204.205:4018 , piece_id=XNJEVEKZ6IKKF657KSNHBUOXLGDIZIYG2BZXTYLDZRNQHRLJYUDQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:22.966509869 (22h5m50.125275593s) [noise=true , address=185.167.204.206:4038 , piece_id=E2NV57T3M3JEJZD6IXDWCAH7STJQTACA2RNRAPAHXRTOJ7U2EYJQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:23.630481954 (22h5m50.789247688s) [noise=true , address=185.167.204.206:4050 , piece_id=L2U45TLX64H57FTUCI4ZDHL6OMJQVPACFRWSZFDYOT7VVK77WC2Q, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:23.707355749 (22h5m50.866121483s) [noise=true , address=185.167.204.205:4023 , piece_id=HPC2WTDR3D67KWZ3B22OVE4UQPRQO6KF65GXHC4BI2JSV4O2JYQA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:30.504116161 (22h5m57.662881895s) [noise=true , address=185.167.204.205:4002 , piece_id=7RLBE2BHBVUY5P24FMFFWS4FULPYVGHSCTTQBQI6ZY4FYXZ2KDWQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:39.370937743 (22h6m6.529703467s) [noise=true , address=185.167.204.206:4071 , piece_id=ZBNSYWOOAEQMQXCGC3PPZW3ATDTWFHOI3WJ6HDKIKT4SD7UOIZWA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:39.572808279 (22h6m6.731574013s) [noise=true , address=185.167.204.206:4054 , piece_id=74EUDBHUO6EXNY2MXWVNUTJEOY4R52NEQ2YORNCQUHUOV23QXWTQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:39.572848445 (22h6m6.731614179s) [seg_pos={0 0}, upload=19313]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:09:39.572962755 (22h6m6.731728479s) [noise=true , address=185.167.204.206:4072 , piece_id=FF4PRULGMLRGOFWM4WZDYPD6ECGPKVCT5Y2JPQJIW44N4DFIVL7Q, seg_pos={0 0}, upload=19313]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v): protocol: expected piece hash; context canceled; EOF
Aug 26 14:09:39.573033460 (22h6m6.731799194s) [noise=true , address=185.167.204.205:4008 , piece_id=HRIX5KLIQYS67KYCKN6BZOCDKEXSAAXH4VI37SLBDBCRIX55FYIA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS): protocol: expected piece hash; context canceled; EOF
Aug 26 14:09:39.573054851 (22h6m6.731820585s) [seg_pos={0 0}, upload=19313]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:09:39.573120396 (22h6m6.73188613s) [upload=19313]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:09:39.573124824 (22h6m6.731890558s) [upload=19313]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:09:39.850037380 (22h6m7.008803114s) [upload=19313]: Done uploading segments...
Aug 26 14:09:39.850055936 (22h6m7.00882167s) [upload=19313]: Upload finished. err: <nil>
Duration: 35.409645312s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
24 out of 60 is failed (threshold=3) [.......XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.XX] duration:
1m0.003478264s
FAIL (2025-08-26 14:10:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.749088434 (22h5m45.907854168s) [noise=true , address=81.171.14.70:4031 , piece_id=SQUB4XE5CIVJDBJYU4IJLTD6YELBI3A2ALCXHMFX2UEBGDHJUE5Q, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.749163638 (22h5m45.907929372s) [noise=true , address=89.149.201.147:4016 , piece_id=AKRPLGFRANOBDWYTYU7JT4LYJBP5CXRBB23ULIOXTMF35F5JEVYA, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.749932008 (22h5m45.908697742s) [noise=true , address=81.171.14.70:4044 , piece_id=3CU4NWO5735WGJ3DL4ZG2Z2UFNHCDX4LMJJVGW6ORZ5IH53OPLGA, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.749978556 (22h5m45.908744291s) [noise=true , address=185.167.204.206:4052 , piece_id=J5FCMYUMEVJDVAKLGQ2GTRR2NOM22QBUZEMIQNYFMBEHPQOLJL4A, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.750295353 (22h5m45.909061087s) [noise=true , address=185.167.204.206:4050 , piece_id=L2U45TLX64H57FTUCI4ZDHL6OMJQVPACFRWSZFDYOT7VVK77WC2Q, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.750608221 (22h5m45.909373955s) [noise=true , address=185.167.204.206:4051 , piece_id=Z7WE726HPEHOWH2VPTLSKFRTBAVNOT4CMCXFGE5LYZHT2JSQ6ZDA, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.751315535 (22h5m45.910081289s) [noise=true , address=89.149.201.147:4010 , piece_id=TMVNRLAL4KVHLLSUGMOWUC4FUDQ7ODGCH2KNC7HAK4ZAZK72L27Q, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.751577837 (22h5m45.910343571s) [noise=true , address=185.167.204.205:4036 , piece_id=E5ZXJFL3KMMDLBZTUIN3EYURYPBL3HMQC2PGBV5ENIRMFAUXWWZQ, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.752305619 (22h5m45.911071353s) [noise=true , address=89.149.201.147:4001 , piece_id=VG5FSIJUPKLIFPDAGMCHY3P75YNFLVN4NGQRNYL2OUHQADFSAKZQ, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.752667262 (22h5m45.911432996s) [noise=true , address=89.149.201.147:4005 , piece_id=ZQNVOJP2XMUS4SL6RYFO7EF4AQKA534U57W56KIPKEJ7D73YVV2Q, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.753531114 (22h5m45.912296848s) [noise=true , address=185.167.204.205:4023 , piece_id=HPC2WTDR3D67KWZ3B22OVE4UQPRQO6KF65GXHC4BI2JSV4O2JYQA, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.754099492 (22h5m45.912865226s) [noise=true , address=185.167.204.205:4013 , piece_id=ALJFONWED5GKYL4H73IBM2UY4A6AT3ISX7EHHRRZMPCOVHD6CLLA, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:18.754858564 (22h5m45.913624298s) [noise=true , address=185.167.204.205:4031 , piece_id=3TLXLCTQNLDCV46RWB2NKBFM525QLFUFEYVTTNEPFVEZB7TZFWNQ, seg_pos={0 0}, upload=19313]: Uploading piece...
Aug 26 14:09:19.604061384 (22h5m46.762827118s) [upload=19313]: Next returned nil segment
Aug 26 14:09:19.604078477 (22h5m46.762844211s) [upload=19313]: Waiting for error group managing segments...
Aug 26 14:09:20.005941848 (22h5m47.164707582s) [noise=true , address=81.171.14.70:4031 , piece_id=SQUB4XE5CIVJDBJYU4IJLTD6YELBI3A2ALCXHMFX2UEBGDHJUE5Q, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.008456600 (22h5m47.167222324s) [noise=true , address=81.171.14.70:4029 , piece_id=KMJS2SNDK6YYNE2VPBUFGGPLZPWRL76NH2ZABLML3Z3R6YNWROZQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.023690511 (22h5m47.182456245s) [noise=true , address=89.149.201.147:4015 , piece_id=FS5OSFTICBMWWSUBL3EMF5SWGYDLFZNFYRNYL7BMQIPKH6DPS2GQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.024460285 (22h5m47.183226019s) [noise=true , address=89.149.201.147:4016 , piece_id=AKRPLGFRANOBDWYTYU7JT4LYJBP5CXRBB23ULIOXTMF35F5JEVYA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.039310341 (22h5m47.198076075s) [noise=true , address=81.171.14.70:4030 , piece_id=LKGISC6VM2ZL52A5CFSUYUBYEC77JIZO6W36L462EOYG32A7OEBA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.044724633 (22h5m47.203490367s) [noise=true , address=89.149.201.147:4010 , piece_id=TMVNRLAL4KVHLLSUGMOWUC4FUDQ7ODGCH2KNC7HAK4ZAZK72L27Q, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.073161499 (22h5m47.231927233s) [noise=true , address=89.149.201.147:4005 , piece_id=ZQNVOJP2XMUS4SL6RYFO7EF4AQKA534U57W56KIPKEJ7D73YVV2Q, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.101835819 (22h5m47.260601553s) [noise=true , address=89.149.201.147:4001 , piece_id=VG5FSIJUPKLIFPDAGMCHY3P75YNFLVN4NGQRNYL2OUHQADFSAKZQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:20.156959202 (22h5m47.315724926s) [noise=true , address=81.171.14.70:4044 , piece_id=3CU4NWO5735WGJ3DL4ZG2Z2UFNHCDX4LMJJVGW6ORZ5IH53OPLGA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.444834369 (22h5m48.603600103s) [noise=true , address=185.167.204.205:4007 , piece_id=ERNGD3BYBLMBFOSYGQK3RDDMOEVEOVQZ2INDXHNSPM5ZYA66UM2A, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.476827429 (22h5m48.635593153s) [noise=true , address=185.167.204.205:4013 , piece_id=ALJFONWED5GKYL4H73IBM2UY4A6AT3ISX7EHHRRZMPCOVHD6CLLA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.498283377 (22h5m48.657049111s) [noise=true , address=185.167.204.206:4065 , piece_id=KGCLCNEX4KTZI7W4KZMAGJUBEMURP2IUXC6Z2LVT6W6UY7BNSCYQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.526327351 (22h5m48.685093085s) [noise=true , address=185.167.204.205:4030 , piece_id=RWPTEMVBKSCFIZJANNGK2F72LGIOC2KJD5532B2YASQQCS4H5C4A, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.591982327 (22h5m48.750748091s) [noise=true , address=185.167.204.205:4031 , piece_id=3TLXLCTQNLDCV46RWB2NKBFM525QLFUFEYVTTNEPFVEZB7TZFWNQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.702846615 (22h5m48.861612349s) [noise=true , address=185.167.204.206:4051 , piece_id=Z7WE726HPEHOWH2VPTLSKFRTBAVNOT4CMCXFGE5LYZHT2JSQ6ZDA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.722853249 (22h5m48.881618983s) [noise=true , address=185.167.204.206:4068 , piece_id=4MIKFJVLPF5K676LC2EC4T32OE44FRLLDP2BZFPI757YM57AQ2QQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.765723986 (22h5m48.92448972s) [noise=true , address=185.167.204.205:4032 , piece_id=ZTTPX3LROGPKIZN7BFCK5SJT26I53AZIL2GDNMRP6ZZLRH6A253A, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:21.986191178 (22h5m49.144956912s) [noise=true , address=185.167.204.205:4036 , piece_id=E5ZXJFL3KMMDLBZTUIN3EYURYPBL3HMQC2PGBV5ENIRMFAUXWWZQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:22.438572337 (22h5m49.597338061s) [noise=true , address=185.167.204.206:4052 , piece_id=J5FCMYUMEVJDVAKLGQ2GTRR2NOM22QBUZEMIQNYFMBEHPQOLJL4A, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:22.846086650 (22h5m50.004852384s) [noise=true , address=185.167.204.205:4018 , piece_id=XNJEVEKZ6IKKF657KSNHBUOXLGDIZIYG2BZXTYLDZRNQHRLJYUDQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:22.966509869 (22h5m50.125275593s) [noise=true , address=185.167.204.206:4038 , piece_id=E2NV57T3M3JEJZD6IXDWCAH7STJQTACA2RNRAPAHXRTOJ7U2EYJQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:23.630481954 (22h5m50.789247688s) [noise=true , address=185.167.204.206:4050 , piece_id=L2U45TLX64H57FTUCI4ZDHL6OMJQVPACFRWSZFDYOT7VVK77WC2Q, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:23.707355749 (22h5m50.866121483s) [noise=true , address=185.167.204.205:4023 , piece_id=HPC2WTDR3D67KWZ3B22OVE4UQPRQO6KF65GXHC4BI2JSV4O2JYQA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:30.504116161 (22h5m57.662881895s) [noise=true , address=185.167.204.205:4002 , piece_id=7RLBE2BHBVUY5P24FMFFWS4FULPYVGHSCTTQBQI6ZY4FYXZ2KDWQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:39.370937743 (22h6m6.529703467s) [noise=true , address=185.167.204.206:4071 , piece_id=ZBNSYWOOAEQMQXCGC3PPZW3ATDTWFHOI3WJ6HDKIKT4SD7UOIZWA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:39.572808279 (22h6m6.731574013s) [noise=true , address=185.167.204.206:4054 , piece_id=74EUDBHUO6EXNY2MXWVNUTJEOY4R52NEQ2YORNCQUHUOV23QXWTQ, seg_pos={0 0}, upload=19313]: Done uploading piece. err: <nil>
Aug 26 14:09:39.572848445 (22h6m6.731614179s) [seg_pos={0 0}, upload=19313]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:09:39.572962755 (22h6m6.731728479s) [noise=true , address=185.167.204.206:4072 , piece_id=FF4PRULGMLRGOFWM4WZDYPD6ECGPKVCT5Y2JPQJIW44N4DFIVL7Q, seg_pos={0 0}, upload=19313]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v): protocol: expected piece hash; context canceled; EOF
Aug 26 14:09:39.573033460 (22h6m6.731799194s) [noise=true , address=185.167.204.205:4008 , piece_id=HRIX5KLIQYS67KYCKN6BZOCDKEXSAAXH4VI37SLBDBCRIX55FYIA, seg_pos={0 0}, upload=19313]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS): protocol: expected piece hash; context canceled; EOF
Aug 26 14:09:39.573054851 (22h6m6.731820585s) [seg_pos={0 0}, upload=19313]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:09:39.573120396 (22h6m6.73188613s) [upload=19313]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:09:39.573124824 (22h6m6.731890558s) [upload=19313]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:09:39.850037380 (22h6m7.008803114s) [upload=19313]: Done uploading segments...
Aug 26 14:09:39.850055936 (22h6m7.00882167s) [upload=19313]: Upload finished. err: <nil>
Duration: 1m0.003488903s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
23 out of 60 is failed (threshold=3) [........XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.X] duration:
1m0.004720575s
FAIL (2025-08-26 14:09:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.14.70:4038 , piece_id=IS4PZ2EKI74FJL3NGO23ZZ7EAOAA6EGGUUKVGJZGQUUDJJJ4RPPA, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.475360234 (22h4m45.634125978s) [noise=true , address=185.167.204.206:4054 , piece_id=AGZZAQD3UE2NRNPJH6FNMYBQYGYP4OYAFAOACYU6FUH3ZUUEAAVQ, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.475506704 (22h4m45.634272438s) [noise=true , address=81.171.14.70:4041 , piece_id=AM3I7SHSIUYSIHYKKWEPSTRUOTH46W3WSYAFROXNY74MJX5LWAAA, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.475743497 (22h4m45.634509231s) [noise=true , address=185.167.204.206:4044 , piece_id=2ZNNEOVMBPUK4RRFCFGMD3LATOCPXJTST4JHTMR5I5YQ52Y4C73A, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.475905087 (22h4m45.634670821s) [noise=true , address=81.171.14.70:4034 , piece_id=VQKYAE7VJASICHQTUGXSHUR6DJD55R5T7J5WU5RADEHV4SXE64RA, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.476013965 (22h4m45.634779699s) [noise=true , address=89.149.201.147:4020 , piece_id=ROIDGQJWZHLLU2ZLWUBUCNF2TL243Y35KYJ3ZPFM7HWXJE4GIH2Q, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.476289222 (22h4m45.635054956s) [noise=true , address=89.149.201.147:4014 , piece_id=LN7EMIU26R644T3VV4Y6BVRVU2SKAAF4RNY3FEVIXABTRFGFP6AQ, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.476309229 (22h4m45.635074963s) [noise=true , address=81.171.14.70:4046 , piece_id=4BXTGMMHKUEZFPZWUX634NS4MYF7F4R2ZEA4GEVHVXUCTRK4N2NA, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.476682033 (22h4m45.635447767s) [noise=true , address=185.167.204.206:4069 , piece_id=V7EAG5N4WJWMEQRGXDY2EFKVQLU6HFJ6UDFRHSSJYYWIO6ALCH2Q, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.477130340 (22h4m45.635896074s) [noise=true , address=185.167.204.206:4037 , piece_id=DSPMHZ6JIMP3CIIPE67DFNA2JLIHENMDCMX46GSBY2MP3L3LORMQ, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.477520498 (22h4m45.636286242s) [noise=true , address=89.149.201.147:4019 , piece_id=2HRTG6LVLC5IPXZXT6F4LKQ25WXYB4QKZPGYCJZFSOVR4COJJPTA, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.477878593 (22h4m45.636644327s) [noise=true , address=185.167.204.206:4053 , piece_id=MTMK76NJK5VW6GW3EOTSL243NGNNX37YVUHU6KYFGSGYRUGY7B5Q, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:18.478226498 (22h4m45.636992232s) [noise=true , address=81.171.14.70:4025 , piece_id=A3GDO47TO2ZM4LUYCL62PULZC2FNWY7DD6BYGEJZ3PZDLULJ226A, seg_pos={0 0}, upload=19299]: Uploading piece...
Aug 26 14:08:19.315582231 (22h4m46.474347965s) [upload=19299]: Next returned nil segment
Aug 26 14:08:19.315601889 (22h4m46.474367623s) [upload=19299]: Waiting for error group managing segments...
Aug 26 14:08:19.709068424 (22h4m46.867834158s) [noise=true , address=81.171.14.70:4034 , piece_id=VQKYAE7VJASICHQTUGXSHUR6DJD55R5T7J5WU5RADEHV4SXE64RA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.710115509 (22h4m46.868881243s) [noise=true , address=81.171.14.70:4036 , piece_id=URSWXKCAYKPJBL5TDMKMGXGYWOZQQIC6PIBE6MBR6KHMAWIX34TA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.715685917 (22h4m46.874451651s) [noise=true , address=81.171.14.70:4046 , piece_id=4BXTGMMHKUEZFPZWUX634NS4MYF7F4R2ZEA4GEVHVXUCTRK4N2NA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.722556322 (22h4m46.881322056s) [noise=true , address=81.171.14.70:4048 , piece_id=IXKR5YHKHK4D2ZYXDGJAXW3ZMNXAEJSZHQQPFXDHZTU7TN2UQ2JQ, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.725656153 (22h4m46.884421877s) [noise=true , address=81.171.14.70:4025 , piece_id=A3GDO47TO2ZM4LUYCL62PULZC2FNWY7DD6BYGEJZ3PZDLULJ226A, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.728035767 (22h4m46.886801501s) [noise=true , address=81.171.14.70:4039 , piece_id=RTOI562AW45SRNQNON5QPOBSVLYSXOHBJM7WY7RIHALF4327CUYA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.739967296 (22h4m46.89873303s) [noise=true , address=89.149.201.147:4022 , piece_id=ON3SH4BYRFLNIUYSTFEA2CIE6XYRCJHJDMSJJT2QCQJEYEB7QWHA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.740168242 (22h4m46.898933976s) [noise=true , address=81.171.14.70:4041 , piece_id=AM3I7SHSIUYSIHYKKWEPSTRUOTH46W3WSYAFROXNY74MJX5LWAAA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.748153571 (22h4m46.906919305s) [noise=true , address=89.149.201.147:4020 , piece_id=ROIDGQJWZHLLU2ZLWUBUCNF2TL243Y35KYJ3ZPFM7HWXJE4GIH2Q, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.760080583 (22h4m46.918846317s) [noise=true , address=89.149.201.147:4014 , piece_id=LN7EMIU26R644T3VV4Y6BVRVU2SKAAF4RNY3FEVIXABTRFGFP6AQ, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.769599145 (22h4m46.928364879s) [noise=true , address=89.149.201.147:4005 , piece_id=BYE7XOKAAQK7TYXNTNZ6SPCU34PMLLVAJOZLBTRCPKAUL4JFHWTA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:19.780656733 (22h4m46.939422467s) [noise=true , address=81.171.14.70:4038 , piece_id=IS4PZ2EKI74FJL3NGO23ZZ7EAOAA6EGGUUKVGJZGQUUDJJJ4RPPA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:20.262447631 (22h4m47.421213355s) [noise=true , address=89.149.201.147:4019 , piece_id=2HRTG6LVLC5IPXZXT6F4LKQ25WXYB4QKZPGYCJZFSOVR4COJJPTA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:21.189858246 (22h4m48.34862398s) [noise=true , address=185.167.204.206:4037 , piece_id=DSPMHZ6JIMP3CIIPE67DFNA2JLIHENMDCMX46GSBY2MP3L3LORMQ, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:21.309321669 (22h4m48.468087403s) [noise=true , address=185.167.204.205:4007 , piece_id=SJHYMVIW4EZ7QSFQ57WUCBRXGAEX6ZSBFAUXOH45MMBSMWPX32PQ, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:21.515626456 (22h4m48.67439219s) [noise=true , address=185.167.204.206:4069 , piece_id=V7EAG5N4WJWMEQRGXDY2EFKVQLU6HFJ6UDFRHSSJYYWIO6ALCH2Q, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:22.075112418 (22h4m49.233878152s) [noise=true , address=185.167.204.206:4055 , piece_id=EHSIMJB2FRSYJD722NBGGXSP4GPECFOZJOOJTMZQEUTLOHH2EXIA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:22.075435396 (22h4m49.23420113s) [noise=true , address=185.167.204.206:4050 , piece_id=ZODJZXOM2BVP7G2J6KXA35455AUYYUDIMWJP4T4G4L2GR5BZ2UZQ, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:22.854548926 (22h4m50.013314661s) [noise=true , address=185.167.204.206:4067 , piece_id=FOURBH5BGKZVDYR6E2KOOSLBQGWKTF5VMUQWE7OJP4SNEW3ZWDOQ, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:23.106064191 (22h4m50.264829925s) [noise=true , address=185.167.204.205:4030 , piece_id=FD4L7HOUTLPYPYPSJRHSP5WWXWZFDJVI34A4D46WMBZM6TEU54AA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:23.254306811 (22h4m50.413072546s) [noise=true , address=185.167.204.206:4053 , piece_id=MTMK76NJK5VW6GW3EOTSL243NGNNX37YVUHU6KYFGSGYRUGY7B5Q, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:23.290358082 (22h4m50.449123836s) [noise=true , address=185.167.204.206:4044 , piece_id=2ZNNEOVMBPUK4RRFCFGMD3LATOCPXJTST4JHTMR5I5YQ52Y4C73A, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:23.418665639 (22h4m50.577431373s) [noise=true , address=185.167.204.205:4035 , piece_id=QSHP6VRXVPGA4XBB6362OVKPA5MVY3CK5TJJ56US42OWMXAQKIMA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:24.026843037 (22h4m51.185608771s) [noise=true , address=185.167.204.206:4064 , piece_id=ETCZRDYWDPRIYNILHZCY2B4GWL3ZN3EIF4OXXT55AO2QVDNEPJXQ, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:24.953396101 (22h4m52.112161835s) [noise=true , address=185.167.204.206:4054 , piece_id=AGZZAQD3UE2NRNPJH6FNMYBQYGYP4OYAFAOACYU6FUH3ZUUEAAVQ, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:30.969597357 (22h4m58.128363091s) [noise=true , address=185.167.204.206:4061 , piece_id=STI7LZFNYDP4WGJVBADBUBFQICLIB2IMLZCNOKXK42ZPCP3MXQAA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: <nil>
Aug 26 14:08:30.969621203 (22h4m58.128386937s) [seg_pos={0 0}, upload=19299]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:08:30.969738517 (22h4m58.128504251s) [noise=true , address=185.167.204.205:4014 , piece_id=KCKSYJDGL4WGQZHGU2W5VTNHPBAHVRF4TSWRHI2XSURD2LBKU6HQ, seg_pos={0 0}, upload=19299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q): protocol: expected piece hash; context canceled; EOF
Aug 26 14:08:30.969958859 (22h4m58.128724593s) [noise=true , address=185.167.204.206:4066 , piece_id=YYAQIYZXXGFXCTPBUCGMHIJZ5FAIKA7CJEI3RL5RX7AI7T5CTWMA, seg_pos={0 0}, upload=19299]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 188.166.225.170:54716->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 26 14:08:30.969973818 (22h4m58.128739552s) [seg_pos={0 0}, upload=19299]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:08:30.970033923 (22h4m58.128799657s) [upload=19299]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:08:30.970037850 (22h4m58.128803584s) [upload=19299]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:08:31.242497159 (22h4m58.401262883s) [upload=19299]: Done uploading segments...
Aug 26 14:08:31.242516045 (22h4m58.401281779s) [upload=19299]: Upload finished. err: <nil>
Duration: 1m0.004744131s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
22 out of 60 is failed (threshold=3) [.........XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X.] duration:
38.0174762s
FAIL (2025-08-26 14:07:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
d=19266]: Uploading piece...
Aug 26 14:06:06.636754810 (22h2m33.795520544s) [noise=true , address=185.167.204.206:4061 , piece_id=QOU466ZJ4CIXZCKW3MUH5NH6OUWMMMB7P4BMEGWOKOFOD4DFOJRQ, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.636940514 (22h2m33.795706248s) [noise=true , address=185.167.204.206:4066 , piece_id=3KYEVUO2R5WXBJ27EWULBSRYAEMV6X5KP4FI4GAOLVEHBBWXCI4Q, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.637120760 (22h2m33.795886494s) [noise=true , address=185.167.204.205:4007 , piece_id=NU2HTRBUS5KPYJ6CUBH65EO5LAOLDYFD3QCSAZGT6VFAGT5VWM7Q, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.637297678 (22h2m33.796063402s) [noise=true , address=185.167.204.205:4015 , piece_id=H4YONR3U2WT7D3ELJRTQ3ONPTWMOPP3W3VXLZFXW6S7QMFOR35JA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.637541845 (22h2m33.796307579s) [noise=true , address=185.167.204.205:4014 , piece_id=4OJEVDWYS5RSEIGGUV3SAUUZ4KG5JONRPK7X2FWTWC2I2HGI44UA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.637727811 (22h2m33.796493545s) [noise=true , address=89.149.201.147:4016 , piece_id=DIEQJWC2G3EJYV2KLPIENHW6N64VXYVHQWZSCA3WLOR6EVUPKJSA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.637927844 (22h2m33.796693578s) [noise=true , address=185.167.204.205:4003 , piece_id=KDWR5EKCVFASMDTEV4VYC3NNLNPQF3CDCRJJLLRZ6GUN7I6K6NJA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.638134680 (22h2m33.796900404s) [noise=true , address=81.171.14.70:4027 , piece_id=SQSCQYUGNQYUNQALOXYIMYMHCJXM3SV77RZSBOSR3VN2JCF6PSFQ, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.638319343 (22h2m33.797085077s) [noise=true , address=81.171.14.70:4035 , piece_id=YTTBQFRMGS3THV7OL3PU5XDQOQZQG3SHLSEEMZLLS27EUIX4JAWQ, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.638509577 (22h2m33.797275311s) [noise=true , address=89.149.201.147:4018 , piece_id=QFMAGJ5G3B4CPZKXMFC5CGHZUUPWTJWLPCK2DHO2J7AJ232FTYWA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.638689110 (22h2m33.797454844s) [noise=true , address=81.171.14.70:4029 , piece_id=VBOWVWIPHONZVS5H7EOGP24ABN7GXO73WZCGQG67IEKXQTWMCYGA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.638867863 (22h2m33.797633597s) [noise=true , address=89.149.201.147:4023 , piece_id=KU3H3ZQXD46CY6NIB34HQZLQ3SX2LZCDNRPOMXJMXWLNJTMCEI7A, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.639044681 (22h2m33.797810415s) [noise=true , address=185.167.204.206:4038 , piece_id=JW7WOOVWFX4UWDD2MS5NRW6WBVRC4E6Z33WKV3HB6TJBXYPRBV2A, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:07.474765264 (22h2m34.633530998s) [upload=19266]: Next returned nil segment
Aug 26 14:06:07.474782597 (22h2m34.633548331s) [upload=19266]: Waiting for error group managing segments...
Aug 26 14:06:07.865759921 (22h2m35.024525655s) [noise=true , address=81.171.14.70:4035 , piece_id=YTTBQFRMGS3THV7OL3PU5XDQOQZQG3SHLSEEMZLLS27EUIX4JAWQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.874125317 (22h2m35.032891051s) [noise=true , address=81.171.14.70:4040 , piece_id=MCZ7HJWCKQMOPFQUB44I5VEPWELEALQNYIFCHN2MPE5D6BMG333A, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.880441172 (22h2m35.039206906s) [noise=true , address=81.171.14.70:4028 , piece_id=ADTK4PVF5CWYCSCXHRMVJE2PTUBXFMQNBJRLAWBQ35KCANXHOGKA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.899334803 (22h2m35.058100548s) [noise=true , address=81.171.14.70:4041 , piece_id=TS23IXTOKSBZRMSYJPXHTGLCWYQNK7BZ4AQLI5VXL47MJRDUKBEQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.915809947 (22h2m35.074575681s) [noise=true , address=89.149.201.147:4016 , piece_id=DIEQJWC2G3EJYV2KLPIENHW6N64VXYVHQWZSCA3WLOR6EVUPKJSA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.916390307 (22h2m35.075156042s) [noise=true , address=89.149.201.147:4023 , piece_id=KU3H3ZQXD46CY6NIB34HQZLQ3SX2LZCDNRPOMXJMXWLNJTMCEI7A, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.920403387 (22h2m35.079169121s) [noise=true , address=89.149.201.147:4006 , piece_id=FH6EMKF34VFWUSH3F7TLAQ3HSNOAOO7KLGEJH5SO6ZREETSO3TFA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.928788251 (22h2m35.087553985s) [noise=true , address=89.149.201.147:4018 , piece_id=QFMAGJ5G3B4CPZKXMFC5CGHZUUPWTJWLPCK2DHO2J7AJ232FTYWA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.930756125 (22h2m35.089521859s) [noise=true , address=81.171.14.70:4027 , piece_id=SQSCQYUGNQYUNQALOXYIMYMHCJXM3SV77RZSBOSR3VN2JCF6PSFQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.953581209 (22h2m35.112346963s) [noise=true , address=89.149.201.147:4012 , piece_id=MSUCD53UAVESGUCQG3DULHJF2CU6AQX6FYGIQS2KGH3TSSGGRSHQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.961491395 (22h2m35.120257129s) [noise=true , address=81.171.14.70:4029 , piece_id=VBOWVWIPHONZVS5H7EOGP24ABN7GXO73WZCGQG67IEKXQTWMCYGA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.961654748 (22h2m35.120420482s) [noise=true , address=89.149.201.147:4002 , piece_id=QRNVYQRL6BM4UNCC7Y5UBINZC6PRAMCF526YP6JDY55BQNJSTJOQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:09.288854656 (22h2m36.447620391s) [noise=true , address=185.167.204.206:4040 , piece_id=JKQ733PM6USWFBL7N2PAIATMKXOXUORT24XZVGF5XT5VPHIJRS3Q, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:09.363798556 (22h2m36.52256429s) [noise=true , address=185.167.204.206:4061 , piece_id=QOU466ZJ4CIXZCKW3MUH5NH6OUWMMMB7P4BMEGWOKOFOD4DFOJRQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:09.402151601 (22h2m36.560917335s) [noise=true , address=185.167.204.205:4015 , piece_id=H4YONR3U2WT7D3ELJRTQ3ONPTWMOPP3W3VXLZFXW6S7QMFOR35JA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:09.482413767 (22h2m36.641179501s) [noise=true , address=185.167.204.205:4007 , piece_id=NU2HTRBUS5KPYJ6CUBH65EO5LAOLDYFD3QCSAZGT6VFAGT5VWM7Q, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:09.850448602 (22h2m37.009214336s) [noise=true , address=185.167.204.206:4038 , piece_id=JW7WOOVWFX4UWDD2MS5NRW6WBVRC4E6Z33WKV3HB6TJBXYPRBV2A, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.322891553 (22h2m37.481657287s) [noise=true , address=185.167.204.206:4064 , piece_id=SBOERIJLKIZWC7HTQTRRAZFVR3ZS6YP4T2ZUTYZOF4NYVY4GIEAA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.365380231 (22h2m37.524145965s) [noise=true , address=185.167.204.205:4012 , piece_id=TR7YZWLRSIU7JGYE4LHDMQ76VWKA7HXJ4WTR73X5ERWYJWNVBDIA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.388189204 (22h2m37.546954938s) [noise=true , address=185.167.204.206:4068 , piece_id=CAR5VUM67HQM3SGGRBOAOOBVSROJDG6RSDHEIBKTF7DVAZZFOT2A, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.584067661 (22h2m37.742833395s) [noise=true , address=185.167.204.205:4020 , piece_id=AJVD3JQM3ENXTA6BUA5OYOQY7VQYPD5KIFVK2V6HWJHF5AJR44JQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.875564757 (22h2m38.034330491s) [noise=true , address=185.167.204.205:4023 , piece_id=S57WUEP77WR6MLYORJTKJOOCFFXMRW57UAX5ZWQBR4YRQVBYEXYQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.985328581 (22h2m38.144094315s) [noise=true , address=185.167.204.206:4065 , piece_id=236MZUWFS3C3IWWJCYBEIPIYPGGIMOTCCC2LTYKRMGKO4C3SZAEA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:11.361071214 (22h2m38.519836948s) [noise=true , address=185.167.204.206:4066 , piece_id=3KYEVUO2R5WXBJ27EWULBSRYAEMV6X5KP4FI4GAOLVEHBBWXCI4Q, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:13.592077815 (22h2m40.750843549s) [noise=true , address=185.167.204.206:4072 , piece_id=LDWR563OCHBXWBKB4RQTRGHTUYOCQBY7QQTPBTEGMGDDI4DC6IAA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:13.725349269 (22h2m40.884115003s) [noise=true , address=185.167.204.205:4003 , piece_id=KDWR5EKCVFASMDTEV4VYC3NNLNPQF3CDCRJJLLRZ6GUN7I6K6NJA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:13.725369779 (22h2m40.884135503s) [seg_pos={0 0}, upload=19266]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:06:13.725477365 (22h2m40.884243099s) [noise=true , address=185.167.204.206:4067 , piece_id=6SCXIWJADRJEDSEE3XBF3DCOGDGRK2DBEQALLDDBFSCPESUI2UAA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS): protocol: expected piece hash; context canceled; EOF
Aug 26 14:06:13.725523973 (22h2m40.884289707s) [noise=true , address=185.167.204.205:4014 , piece_id=4OJEVDWYS5RSEIGGUV3SAUUZ4KG5JONRPK7X2FWTWC2I2HGI44UA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q): protocol: expected piece hash; context canceled; EOF
Aug 26 14:06:13.725535917 (22h2m40.884301651s) [seg_pos={0 0}, upload=19266]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:06:13.725597604 (22h2m40.884363338s) [upload=19266]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:06:13.725602113 (22h2m40.884367847s) [upload=19266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:06:13.986226397 (22h2m41.144992181s) [upload=19266]: Done uploading segments...
Aug 26 14:06:13.986248689 (22h2m41.145014484s) [upload=19266]: Upload finished. err: <nil>
Duration: 38.017506647s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.95486302s
FAIL (2025-08-26 14:07:09 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 6.954892627s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
22 out of 60 is failed (threshold=3) [..........XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......X] duration:
1m0.002283336s
FAIL (2025-08-26 14:07:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
d=19266]: Uploading piece...
Aug 26 14:06:06.636754810 (22h2m33.795520544s) [noise=true , address=185.167.204.206:4061 , piece_id=QOU466ZJ4CIXZCKW3MUH5NH6OUWMMMB7P4BMEGWOKOFOD4DFOJRQ, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.636940514 (22h2m33.795706248s) [noise=true , address=185.167.204.206:4066 , piece_id=3KYEVUO2R5WXBJ27EWULBSRYAEMV6X5KP4FI4GAOLVEHBBWXCI4Q, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.637120760 (22h2m33.795886494s) [noise=true , address=185.167.204.205:4007 , piece_id=NU2HTRBUS5KPYJ6CUBH65EO5LAOLDYFD3QCSAZGT6VFAGT5VWM7Q, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.637297678 (22h2m33.796063402s) [noise=true , address=185.167.204.205:4015 , piece_id=H4YONR3U2WT7D3ELJRTQ3ONPTWMOPP3W3VXLZFXW6S7QMFOR35JA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.637541845 (22h2m33.796307579s) [noise=true , address=185.167.204.205:4014 , piece_id=4OJEVDWYS5RSEIGGUV3SAUUZ4KG5JONRPK7X2FWTWC2I2HGI44UA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.637727811 (22h2m33.796493545s) [noise=true , address=89.149.201.147:4016 , piece_id=DIEQJWC2G3EJYV2KLPIENHW6N64VXYVHQWZSCA3WLOR6EVUPKJSA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.637927844 (22h2m33.796693578s) [noise=true , address=185.167.204.205:4003 , piece_id=KDWR5EKCVFASMDTEV4VYC3NNLNPQF3CDCRJJLLRZ6GUN7I6K6NJA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.638134680 (22h2m33.796900404s) [noise=true , address=81.171.14.70:4027 , piece_id=SQSCQYUGNQYUNQALOXYIMYMHCJXM3SV77RZSBOSR3VN2JCF6PSFQ, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.638319343 (22h2m33.797085077s) [noise=true , address=81.171.14.70:4035 , piece_id=YTTBQFRMGS3THV7OL3PU5XDQOQZQG3SHLSEEMZLLS27EUIX4JAWQ, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.638509577 (22h2m33.797275311s) [noise=true , address=89.149.201.147:4018 , piece_id=QFMAGJ5G3B4CPZKXMFC5CGHZUUPWTJWLPCK2DHO2J7AJ232FTYWA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.638689110 (22h2m33.797454844s) [noise=true , address=81.171.14.70:4029 , piece_id=VBOWVWIPHONZVS5H7EOGP24ABN7GXO73WZCGQG67IEKXQTWMCYGA, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.638867863 (22h2m33.797633597s) [noise=true , address=89.149.201.147:4023 , piece_id=KU3H3ZQXD46CY6NIB34HQZLQ3SX2LZCDNRPOMXJMXWLNJTMCEI7A, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:06.639044681 (22h2m33.797810415s) [noise=true , address=185.167.204.206:4038 , piece_id=JW7WOOVWFX4UWDD2MS5NRW6WBVRC4E6Z33WKV3HB6TJBXYPRBV2A, seg_pos={0 0}, upload=19266]: Uploading piece...
Aug 26 14:06:07.474765264 (22h2m34.633530998s) [upload=19266]: Next returned nil segment
Aug 26 14:06:07.474782597 (22h2m34.633548331s) [upload=19266]: Waiting for error group managing segments...
Aug 26 14:06:07.865759921 (22h2m35.024525655s) [noise=true , address=81.171.14.70:4035 , piece_id=YTTBQFRMGS3THV7OL3PU5XDQOQZQG3SHLSEEMZLLS27EUIX4JAWQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.874125317 (22h2m35.032891051s) [noise=true , address=81.171.14.70:4040 , piece_id=MCZ7HJWCKQMOPFQUB44I5VEPWELEALQNYIFCHN2MPE5D6BMG333A, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.880441172 (22h2m35.039206906s) [noise=true , address=81.171.14.70:4028 , piece_id=ADTK4PVF5CWYCSCXHRMVJE2PTUBXFMQNBJRLAWBQ35KCANXHOGKA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.899334803 (22h2m35.058100548s) [noise=true , address=81.171.14.70:4041 , piece_id=TS23IXTOKSBZRMSYJPXHTGLCWYQNK7BZ4AQLI5VXL47MJRDUKBEQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.915809947 (22h2m35.074575681s) [noise=true , address=89.149.201.147:4016 , piece_id=DIEQJWC2G3EJYV2KLPIENHW6N64VXYVHQWZSCA3WLOR6EVUPKJSA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.916390307 (22h2m35.075156042s) [noise=true , address=89.149.201.147:4023 , piece_id=KU3H3ZQXD46CY6NIB34HQZLQ3SX2LZCDNRPOMXJMXWLNJTMCEI7A, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.920403387 (22h2m35.079169121s) [noise=true , address=89.149.201.147:4006 , piece_id=FH6EMKF34VFWUSH3F7TLAQ3HSNOAOO7KLGEJH5SO6ZREETSO3TFA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.928788251 (22h2m35.087553985s) [noise=true , address=89.149.201.147:4018 , piece_id=QFMAGJ5G3B4CPZKXMFC5CGHZUUPWTJWLPCK2DHO2J7AJ232FTYWA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.930756125 (22h2m35.089521859s) [noise=true , address=81.171.14.70:4027 , piece_id=SQSCQYUGNQYUNQALOXYIMYMHCJXM3SV77RZSBOSR3VN2JCF6PSFQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.953581209 (22h2m35.112346963s) [noise=true , address=89.149.201.147:4012 , piece_id=MSUCD53UAVESGUCQG3DULHJF2CU6AQX6FYGIQS2KGH3TSSGGRSHQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.961491395 (22h2m35.120257129s) [noise=true , address=81.171.14.70:4029 , piece_id=VBOWVWIPHONZVS5H7EOGP24ABN7GXO73WZCGQG67IEKXQTWMCYGA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:07.961654748 (22h2m35.120420482s) [noise=true , address=89.149.201.147:4002 , piece_id=QRNVYQRL6BM4UNCC7Y5UBINZC6PRAMCF526YP6JDY55BQNJSTJOQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:09.288854656 (22h2m36.447620391s) [noise=true , address=185.167.204.206:4040 , piece_id=JKQ733PM6USWFBL7N2PAIATMKXOXUORT24XZVGF5XT5VPHIJRS3Q, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:09.363798556 (22h2m36.52256429s) [noise=true , address=185.167.204.206:4061 , piece_id=QOU466ZJ4CIXZCKW3MUH5NH6OUWMMMB7P4BMEGWOKOFOD4DFOJRQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:09.402151601 (22h2m36.560917335s) [noise=true , address=185.167.204.205:4015 , piece_id=H4YONR3U2WT7D3ELJRTQ3ONPTWMOPP3W3VXLZFXW6S7QMFOR35JA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:09.482413767 (22h2m36.641179501s) [noise=true , address=185.167.204.205:4007 , piece_id=NU2HTRBUS5KPYJ6CUBH65EO5LAOLDYFD3QCSAZGT6VFAGT5VWM7Q, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:09.850448602 (22h2m37.009214336s) [noise=true , address=185.167.204.206:4038 , piece_id=JW7WOOVWFX4UWDD2MS5NRW6WBVRC4E6Z33WKV3HB6TJBXYPRBV2A, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.322891553 (22h2m37.481657287s) [noise=true , address=185.167.204.206:4064 , piece_id=SBOERIJLKIZWC7HTQTRRAZFVR3ZS6YP4T2ZUTYZOF4NYVY4GIEAA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.365380231 (22h2m37.524145965s) [noise=true , address=185.167.204.205:4012 , piece_id=TR7YZWLRSIU7JGYE4LHDMQ76VWKA7HXJ4WTR73X5ERWYJWNVBDIA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.388189204 (22h2m37.546954938s) [noise=true , address=185.167.204.206:4068 , piece_id=CAR5VUM67HQM3SGGRBOAOOBVSROJDG6RSDHEIBKTF7DVAZZFOT2A, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.584067661 (22h2m37.742833395s) [noise=true , address=185.167.204.205:4020 , piece_id=AJVD3JQM3ENXTA6BUA5OYOQY7VQYPD5KIFVK2V6HWJHF5AJR44JQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.875564757 (22h2m38.034330491s) [noise=true , address=185.167.204.205:4023 , piece_id=S57WUEP77WR6MLYORJTKJOOCFFXMRW57UAX5ZWQBR4YRQVBYEXYQ, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:10.985328581 (22h2m38.144094315s) [noise=true , address=185.167.204.206:4065 , piece_id=236MZUWFS3C3IWWJCYBEIPIYPGGIMOTCCC2LTYKRMGKO4C3SZAEA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:11.361071214 (22h2m38.519836948s) [noise=true , address=185.167.204.206:4066 , piece_id=3KYEVUO2R5WXBJ27EWULBSRYAEMV6X5KP4FI4GAOLVEHBBWXCI4Q, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:13.592077815 (22h2m40.750843549s) [noise=true , address=185.167.204.206:4072 , piece_id=LDWR563OCHBXWBKB4RQTRGHTUYOCQBY7QQTPBTEGMGDDI4DC6IAA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:13.725349269 (22h2m40.884115003s) [noise=true , address=185.167.204.205:4003 , piece_id=KDWR5EKCVFASMDTEV4VYC3NNLNPQF3CDCRJJLLRZ6GUN7I6K6NJA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: <nil>
Aug 26 14:06:13.725369779 (22h2m40.884135503s) [seg_pos={0 0}, upload=19266]: Segment reached optimal threshold of 26 pieces.
Aug 26 14:06:13.725477365 (22h2m40.884243099s) [noise=true , address=185.167.204.206:4067 , piece_id=6SCXIWJADRJEDSEE3XBF3DCOGDGRK2DBEQALLDDBFSCPESUI2UAA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS): protocol: expected piece hash; context canceled; EOF
Aug 26 14:06:13.725523973 (22h2m40.884289707s) [noise=true , address=185.167.204.205:4014 , piece_id=4OJEVDWYS5RSEIGGUV3SAUUZ4KG5JONRPK7X2FWTWC2I2HGI44UA, seg_pos={0 0}, upload=19266]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q): protocol: expected piece hash; context canceled; EOF
Aug 26 14:06:13.725535917 (22h2m40.884301651s) [seg_pos={0 0}, upload=19266]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 14:06:13.725597604 (22h2m40.884363338s) [upload=19266]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 14:06:13.725602113 (22h2m40.884367847s) [upload=19266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 14:06:13.986226397 (22h2m41.144992181s) [upload=19266]: Done uploading segments...
Aug 26 14:06:13.986248689 (22h2m41.145014484s) [upload=19266]: Upload finished. err: <nil>
Duration: 1m0.002307573s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
21 out of 60 is failed (threshold=3) [...........XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.......] duration:
38.008725809s
FAIL (2025-08-26 14:06:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
oad=19174]: Uploading piece...
Aug 26 13:59:36.361433005 (21h56m3.520198739s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361656342 (21h56m3.520422077s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361879810 (21h56m3.520645544s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362073460 (21h56m3.520839194s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362283903 (21h56m3.521049637s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362495227 (21h56m3.521260971s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362725538 (21h56m3.521491282s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362953544 (21h56m3.521719278s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363155590 (21h56m3.521921325s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363401982 (21h56m3.522167716s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363656129 (21h56m3.522421863s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363894394 (21h56m3.522660128s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.364117371 (21h56m3.522883105s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:37.199272341 (21h56m4.358038065s) [upload=19174]: Next returned nil segment
Aug 26 13:59:37.199285717 (21h56m4.358051451s) [upload=19174]: Waiting for error group managing segments...
Aug 26 13:59:37.589580034 (21h56m4.748345758s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.594131703 (21h56m4.752897427s) [noise=true , address=81.171.14.70:4040 , piece_id=CLDSUJTU4J5UOXIQH2YSGQ433DNEVMSTPOMJVF2JNXQNFWCGIVYQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.596256668 (21h56m4.755022402s) [noise=true , address=81.171.14.70:4037 , piece_id=27ZPXRI23RUI54ICPP54BSSKJ2LE3PHOLJ4YBJLWSIHEBEVV7NBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.608940849 (21h56m4.767706583s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.611766345 (21h56m4.770532069s) [noise=true , address=81.171.14.70:4032 , piece_id=GQZ75ME37FRTKBRAJSINSL5NVJ4I2MYW7XQ5FXWSSE5RGMFUPNLA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.618286370 (21h56m4.777052105s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.624170670 (21h56m4.782936404s) [noise=true , address=81.171.14.70:4038 , piece_id=3W3A5FK6POPOZKVX4JENXWUCGPIN4IDXXLMRTWK7FFLJIULUVMPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.630168607 (21h56m4.788934341s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.632247794 (21h56m4.791013528s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.640167778 (21h56m4.798933502s) [noise=true , address=81.171.14.70:4044 , piece_id=R6GEYW6DRV342SKWI2WDDJ72YMYOTAHWKEAI2SVSCTVMLM5RCVSQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.645174348 (21h56m4.803940082s) [noise=true , address=89.149.201.147:4020 , piece_id=6UIQHU243AB4CXBFFHKWMSFEFRXYOUGCDYG2BJYCGEUCZLVC3HKA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.648180631 (21h56m4.806946365s) [noise=true , address=89.149.201.147:4019 , piece_id=6Y43IY5G76VKCSCEENP52G7MBIGUXYC3CXLLE6JSPD7OPZTFMNVA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.661047811 (21h56m4.819813545s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.666915147 (21h56m4.825680881s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.670273844 (21h56m4.829039578s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.684106131 (21h56m4.842871865s) [noise=true , address=89.149.201.147:4017 , piece_id=MKT3FFR4AEZJK5ZRT3I3NULCM5RV4GBHZIGJAUDYRQDUJZ2SV2YQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.692082484 (21h56m4.850848208s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.695714633 (21h56m4.854480367s) [noise=true , address=89.149.201.147:4008 , piece_id=USSJNCI3B7MPQGP6PFPXJDHXPXLA3M2SLGP64K55UDNUTX2G25GA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:38.155467373 (21h56m5.314233097s) [noise=true , address=89.149.201.147:4002 , piece_id=6I6IJHCFTFINP6LZIWEVK5D5HOPY6F3AYUIMJL5UKF35LFXUB2EQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.065060776 (21h56m6.2238265s) [noise=true , address=185.167.204.206:4056 , piece_id=2KMYS36C6EPZEJQ7ZTY2V36JIXMUILI2WLYV4YHWUIQ23VYNL5BA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.616533284 (21h56m6.775299018s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.032758157 (21h56m7.191523891s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.070167937 (21h56m7.228933671s) [noise=true , address=185.167.204.205:4021 , piece_id=O3XIS5F2XZ6ZBRVVFXVRNGK57X4QWAP2WLHITVV4PSWDV6U5PM2Q, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.359213894 (21h56m7.517979628s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:41.026303225 (21h56m8.185068959s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618556863 (21h56m9.777322597s) [noise=true , address=185.167.204.206:4047 , piece_id=BB7CSGKRZVX7XUSFR5RXVMBMYN7AXC6YPL6A3POOSPAPCPNNS3QQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618585117 (21h56m9.777350841s) [seg_pos={0 0}, upload=19174]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:59:42.618695368 (21h56m9.777461102s) [noise=true , address=185.167.204.205:4025 , piece_id=I2UPKQ3L2EZVJKSKRY752HJXNF54XNOFGGECQSZW4QA3BOHL6SBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618821689 (21h56m9.777587423s) [noise=true , address=185.167.204.205:4004 , piece_id=IDM75A5R46JRCRSNIQILR7LNUKZWG6S55GROJHB6D4CW4ARNWLHA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618860303 (21h56m9.777626037s) [seg_pos={0 0}, upload=19174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:59:42.618945466 (21h56m9.7777112s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:59:42.618949754 (21h56m9.777715478s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:59:42.868274237 (21h56m10.027039971s) [upload=19174]: Done uploading segments...
Aug 26 13:59:42.868294345 (21h56m10.027060079s) [upload=19174]: Upload finished. err: <nil>
Duration: 38.008758823s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.874600391s
FAIL (2025-08-26 14:05:58 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 5.874624977s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.892240807s
FAIL (2025-08-26 14:05:14 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 6.892268459s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
21 out of 60 is failed (threshold=3) [............XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X......] duration:
31.263505051s
FAIL (2025-08-26 14:04:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
oad=19174]: Uploading piece...
Aug 26 13:59:36.361433005 (21h56m3.520198739s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361656342 (21h56m3.520422077s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361879810 (21h56m3.520645544s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362073460 (21h56m3.520839194s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362283903 (21h56m3.521049637s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362495227 (21h56m3.521260971s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362725538 (21h56m3.521491282s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362953544 (21h56m3.521719278s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363155590 (21h56m3.521921325s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363401982 (21h56m3.522167716s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363656129 (21h56m3.522421863s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363894394 (21h56m3.522660128s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.364117371 (21h56m3.522883105s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:37.199272341 (21h56m4.358038065s) [upload=19174]: Next returned nil segment
Aug 26 13:59:37.199285717 (21h56m4.358051451s) [upload=19174]: Waiting for error group managing segments...
Aug 26 13:59:37.589580034 (21h56m4.748345758s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.594131703 (21h56m4.752897427s) [noise=true , address=81.171.14.70:4040 , piece_id=CLDSUJTU4J5UOXIQH2YSGQ433DNEVMSTPOMJVF2JNXQNFWCGIVYQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.596256668 (21h56m4.755022402s) [noise=true , address=81.171.14.70:4037 , piece_id=27ZPXRI23RUI54ICPP54BSSKJ2LE3PHOLJ4YBJLWSIHEBEVV7NBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.608940849 (21h56m4.767706583s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.611766345 (21h56m4.770532069s) [noise=true , address=81.171.14.70:4032 , piece_id=GQZ75ME37FRTKBRAJSINSL5NVJ4I2MYW7XQ5FXWSSE5RGMFUPNLA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.618286370 (21h56m4.777052105s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.624170670 (21h56m4.782936404s) [noise=true , address=81.171.14.70:4038 , piece_id=3W3A5FK6POPOZKVX4JENXWUCGPIN4IDXXLMRTWK7FFLJIULUVMPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.630168607 (21h56m4.788934341s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.632247794 (21h56m4.791013528s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.640167778 (21h56m4.798933502s) [noise=true , address=81.171.14.70:4044 , piece_id=R6GEYW6DRV342SKWI2WDDJ72YMYOTAHWKEAI2SVSCTVMLM5RCVSQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.645174348 (21h56m4.803940082s) [noise=true , address=89.149.201.147:4020 , piece_id=6UIQHU243AB4CXBFFHKWMSFEFRXYOUGCDYG2BJYCGEUCZLVC3HKA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.648180631 (21h56m4.806946365s) [noise=true , address=89.149.201.147:4019 , piece_id=6Y43IY5G76VKCSCEENP52G7MBIGUXYC3CXLLE6JSPD7OPZTFMNVA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.661047811 (21h56m4.819813545s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.666915147 (21h56m4.825680881s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.670273844 (21h56m4.829039578s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.684106131 (21h56m4.842871865s) [noise=true , address=89.149.201.147:4017 , piece_id=MKT3FFR4AEZJK5ZRT3I3NULCM5RV4GBHZIGJAUDYRQDUJZ2SV2YQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.692082484 (21h56m4.850848208s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.695714633 (21h56m4.854480367s) [noise=true , address=89.149.201.147:4008 , piece_id=USSJNCI3B7MPQGP6PFPXJDHXPXLA3M2SLGP64K55UDNUTX2G25GA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:38.155467373 (21h56m5.314233097s) [noise=true , address=89.149.201.147:4002 , piece_id=6I6IJHCFTFINP6LZIWEVK5D5HOPY6F3AYUIMJL5UKF35LFXUB2EQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.065060776 (21h56m6.2238265s) [noise=true , address=185.167.204.206:4056 , piece_id=2KMYS36C6EPZEJQ7ZTY2V36JIXMUILI2WLYV4YHWUIQ23VYNL5BA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.616533284 (21h56m6.775299018s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.032758157 (21h56m7.191523891s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.070167937 (21h56m7.228933671s) [noise=true , address=185.167.204.205:4021 , piece_id=O3XIS5F2XZ6ZBRVVFXVRNGK57X4QWAP2WLHITVV4PSWDV6U5PM2Q, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.359213894 (21h56m7.517979628s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:41.026303225 (21h56m8.185068959s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618556863 (21h56m9.777322597s) [noise=true , address=185.167.204.206:4047 , piece_id=BB7CSGKRZVX7XUSFR5RXVMBMYN7AXC6YPL6A3POOSPAPCPNNS3QQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618585117 (21h56m9.777350841s) [seg_pos={0 0}, upload=19174]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:59:42.618695368 (21h56m9.777461102s) [noise=true , address=185.167.204.205:4025 , piece_id=I2UPKQ3L2EZVJKSKRY752HJXNF54XNOFGGECQSZW4QA3BOHL6SBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618821689 (21h56m9.777587423s) [noise=true , address=185.167.204.205:4004 , piece_id=IDM75A5R46JRCRSNIQILR7LNUKZWG6S55GROJHB6D4CW4ARNWLHA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618860303 (21h56m9.777626037s) [seg_pos={0 0}, upload=19174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:59:42.618945466 (21h56m9.7777112s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:59:42.618949754 (21h56m9.777715478s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:59:42.868274237 (21h56m10.027039971s) [upload=19174]: Done uploading segments...
Aug 26 13:59:42.868294345 (21h56m10.027060079s) [upload=19174]: Upload finished. err: <nil>
Duration: 31.263523666s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.119248724s
FAIL (2025-08-26 14:04:31 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 6.119272079s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
21 out of 60 is failed (threshold=3) [.............XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.....] duration:
28.536128947s
FAIL (2025-08-26 14:04:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
oad=19174]: Uploading piece...
Aug 26 13:59:36.361433005 (21h56m3.520198739s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361656342 (21h56m3.520422077s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361879810 (21h56m3.520645544s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362073460 (21h56m3.520839194s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362283903 (21h56m3.521049637s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362495227 (21h56m3.521260971s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362725538 (21h56m3.521491282s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362953544 (21h56m3.521719278s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363155590 (21h56m3.521921325s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363401982 (21h56m3.522167716s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363656129 (21h56m3.522421863s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363894394 (21h56m3.522660128s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.364117371 (21h56m3.522883105s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:37.199272341 (21h56m4.358038065s) [upload=19174]: Next returned nil segment
Aug 26 13:59:37.199285717 (21h56m4.358051451s) [upload=19174]: Waiting for error group managing segments...
Aug 26 13:59:37.589580034 (21h56m4.748345758s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.594131703 (21h56m4.752897427s) [noise=true , address=81.171.14.70:4040 , piece_id=CLDSUJTU4J5UOXIQH2YSGQ433DNEVMSTPOMJVF2JNXQNFWCGIVYQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.596256668 (21h56m4.755022402s) [noise=true , address=81.171.14.70:4037 , piece_id=27ZPXRI23RUI54ICPP54BSSKJ2LE3PHOLJ4YBJLWSIHEBEVV7NBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.608940849 (21h56m4.767706583s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.611766345 (21h56m4.770532069s) [noise=true , address=81.171.14.70:4032 , piece_id=GQZ75ME37FRTKBRAJSINSL5NVJ4I2MYW7XQ5FXWSSE5RGMFUPNLA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.618286370 (21h56m4.777052105s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.624170670 (21h56m4.782936404s) [noise=true , address=81.171.14.70:4038 , piece_id=3W3A5FK6POPOZKVX4JENXWUCGPIN4IDXXLMRTWK7FFLJIULUVMPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.630168607 (21h56m4.788934341s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.632247794 (21h56m4.791013528s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.640167778 (21h56m4.798933502s) [noise=true , address=81.171.14.70:4044 , piece_id=R6GEYW6DRV342SKWI2WDDJ72YMYOTAHWKEAI2SVSCTVMLM5RCVSQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.645174348 (21h56m4.803940082s) [noise=true , address=89.149.201.147:4020 , piece_id=6UIQHU243AB4CXBFFHKWMSFEFRXYOUGCDYG2BJYCGEUCZLVC3HKA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.648180631 (21h56m4.806946365s) [noise=true , address=89.149.201.147:4019 , piece_id=6Y43IY5G76VKCSCEENP52G7MBIGUXYC3CXLLE6JSPD7OPZTFMNVA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.661047811 (21h56m4.819813545s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.666915147 (21h56m4.825680881s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.670273844 (21h56m4.829039578s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.684106131 (21h56m4.842871865s) [noise=true , address=89.149.201.147:4017 , piece_id=MKT3FFR4AEZJK5ZRT3I3NULCM5RV4GBHZIGJAUDYRQDUJZ2SV2YQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.692082484 (21h56m4.850848208s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.695714633 (21h56m4.854480367s) [noise=true , address=89.149.201.147:4008 , piece_id=USSJNCI3B7MPQGP6PFPXJDHXPXLA3M2SLGP64K55UDNUTX2G25GA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:38.155467373 (21h56m5.314233097s) [noise=true , address=89.149.201.147:4002 , piece_id=6I6IJHCFTFINP6LZIWEVK5D5HOPY6F3AYUIMJL5UKF35LFXUB2EQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.065060776 (21h56m6.2238265s) [noise=true , address=185.167.204.206:4056 , piece_id=2KMYS36C6EPZEJQ7ZTY2V36JIXMUILI2WLYV4YHWUIQ23VYNL5BA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.616533284 (21h56m6.775299018s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.032758157 (21h56m7.191523891s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.070167937 (21h56m7.228933671s) [noise=true , address=185.167.204.205:4021 , piece_id=O3XIS5F2XZ6ZBRVVFXVRNGK57X4QWAP2WLHITVV4PSWDV6U5PM2Q, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.359213894 (21h56m7.517979628s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:41.026303225 (21h56m8.185068959s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618556863 (21h56m9.777322597s) [noise=true , address=185.167.204.206:4047 , piece_id=BB7CSGKRZVX7XUSFR5RXVMBMYN7AXC6YPL6A3POOSPAPCPNNS3QQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618585117 (21h56m9.777350841s) [seg_pos={0 0}, upload=19174]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:59:42.618695368 (21h56m9.777461102s) [noise=true , address=185.167.204.205:4025 , piece_id=I2UPKQ3L2EZVJKSKRY752HJXNF54XNOFGGECQSZW4QA3BOHL6SBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618821689 (21h56m9.777587423s) [noise=true , address=185.167.204.205:4004 , piece_id=IDM75A5R46JRCRSNIQILR7LNUKZWG6S55GROJHB6D4CW4ARNWLHA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618860303 (21h56m9.777626037s) [seg_pos={0 0}, upload=19174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:59:42.618945466 (21h56m9.7777112s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:59:42.618949754 (21h56m9.777715478s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:59:42.868274237 (21h56m10.027039971s) [upload=19174]: Done uploading segments...
Aug 26 13:59:42.868294345 (21h56m10.027060079s) [upload=19174]: Upload finished. err: <nil>
Duration: 28.536155086s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.948715694s
FAIL (2025-08-26 14:03:47 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 5.948741553s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
21 out of 60 is failed (threshold=3) [..............XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X....] duration:
25.874610316s
FAIL (2025-08-26 14:03:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
oad=19174]: Uploading piece...
Aug 26 13:59:36.361433005 (21h56m3.520198739s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361656342 (21h56m3.520422077s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361879810 (21h56m3.520645544s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362073460 (21h56m3.520839194s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362283903 (21h56m3.521049637s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362495227 (21h56m3.521260971s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362725538 (21h56m3.521491282s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362953544 (21h56m3.521719278s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363155590 (21h56m3.521921325s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363401982 (21h56m3.522167716s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363656129 (21h56m3.522421863s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363894394 (21h56m3.522660128s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.364117371 (21h56m3.522883105s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:37.199272341 (21h56m4.358038065s) [upload=19174]: Next returned nil segment
Aug 26 13:59:37.199285717 (21h56m4.358051451s) [upload=19174]: Waiting for error group managing segments...
Aug 26 13:59:37.589580034 (21h56m4.748345758s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.594131703 (21h56m4.752897427s) [noise=true , address=81.171.14.70:4040 , piece_id=CLDSUJTU4J5UOXIQH2YSGQ433DNEVMSTPOMJVF2JNXQNFWCGIVYQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.596256668 (21h56m4.755022402s) [noise=true , address=81.171.14.70:4037 , piece_id=27ZPXRI23RUI54ICPP54BSSKJ2LE3PHOLJ4YBJLWSIHEBEVV7NBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.608940849 (21h56m4.767706583s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.611766345 (21h56m4.770532069s) [noise=true , address=81.171.14.70:4032 , piece_id=GQZ75ME37FRTKBRAJSINSL5NVJ4I2MYW7XQ5FXWSSE5RGMFUPNLA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.618286370 (21h56m4.777052105s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.624170670 (21h56m4.782936404s) [noise=true , address=81.171.14.70:4038 , piece_id=3W3A5FK6POPOZKVX4JENXWUCGPIN4IDXXLMRTWK7FFLJIULUVMPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.630168607 (21h56m4.788934341s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.632247794 (21h56m4.791013528s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.640167778 (21h56m4.798933502s) [noise=true , address=81.171.14.70:4044 , piece_id=R6GEYW6DRV342SKWI2WDDJ72YMYOTAHWKEAI2SVSCTVMLM5RCVSQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.645174348 (21h56m4.803940082s) [noise=true , address=89.149.201.147:4020 , piece_id=6UIQHU243AB4CXBFFHKWMSFEFRXYOUGCDYG2BJYCGEUCZLVC3HKA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.648180631 (21h56m4.806946365s) [noise=true , address=89.149.201.147:4019 , piece_id=6Y43IY5G76VKCSCEENP52G7MBIGUXYC3CXLLE6JSPD7OPZTFMNVA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.661047811 (21h56m4.819813545s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.666915147 (21h56m4.825680881s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.670273844 (21h56m4.829039578s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.684106131 (21h56m4.842871865s) [noise=true , address=89.149.201.147:4017 , piece_id=MKT3FFR4AEZJK5ZRT3I3NULCM5RV4GBHZIGJAUDYRQDUJZ2SV2YQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.692082484 (21h56m4.850848208s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.695714633 (21h56m4.854480367s) [noise=true , address=89.149.201.147:4008 , piece_id=USSJNCI3B7MPQGP6PFPXJDHXPXLA3M2SLGP64K55UDNUTX2G25GA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:38.155467373 (21h56m5.314233097s) [noise=true , address=89.149.201.147:4002 , piece_id=6I6IJHCFTFINP6LZIWEVK5D5HOPY6F3AYUIMJL5UKF35LFXUB2EQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.065060776 (21h56m6.2238265s) [noise=true , address=185.167.204.206:4056 , piece_id=2KMYS36C6EPZEJQ7ZTY2V36JIXMUILI2WLYV4YHWUIQ23VYNL5BA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.616533284 (21h56m6.775299018s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.032758157 (21h56m7.191523891s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.070167937 (21h56m7.228933671s) [noise=true , address=185.167.204.205:4021 , piece_id=O3XIS5F2XZ6ZBRVVFXVRNGK57X4QWAP2WLHITVV4PSWDV6U5PM2Q, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.359213894 (21h56m7.517979628s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:41.026303225 (21h56m8.185068959s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618556863 (21h56m9.777322597s) [noise=true , address=185.167.204.206:4047 , piece_id=BB7CSGKRZVX7XUSFR5RXVMBMYN7AXC6YPL6A3POOSPAPCPNNS3QQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618585117 (21h56m9.777350841s) [seg_pos={0 0}, upload=19174]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:59:42.618695368 (21h56m9.777461102s) [noise=true , address=185.167.204.205:4025 , piece_id=I2UPKQ3L2EZVJKSKRY752HJXNF54XNOFGGECQSZW4QA3BOHL6SBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618821689 (21h56m9.777587423s) [noise=true , address=185.167.204.205:4004 , piece_id=IDM75A5R46JRCRSNIQILR7LNUKZWG6S55GROJHB6D4CW4ARNWLHA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618860303 (21h56m9.777626037s) [seg_pos={0 0}, upload=19174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:59:42.618945466 (21h56m9.7777112s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:59:42.618949754 (21h56m9.777715478s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:59:42.868274237 (21h56m10.027039971s) [upload=19174]: Done uploading segments...
Aug 26 13:59:42.868294345 (21h56m10.027060079s) [upload=19174]: Upload finished. err: <nil>
Duration: 25.874637569s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.447471557s
FAIL (2025-08-26 14:03:23 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 5.447498669s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
21 out of 60 is failed (threshold=3) [...............XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X...] duration:
25.338467488s
FAIL (2025-08-26 14:02:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
oad=19174]: Uploading piece...
Aug 26 13:59:36.361433005 (21h56m3.520198739s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361656342 (21h56m3.520422077s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361879810 (21h56m3.520645544s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362073460 (21h56m3.520839194s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362283903 (21h56m3.521049637s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362495227 (21h56m3.521260971s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362725538 (21h56m3.521491282s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362953544 (21h56m3.521719278s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363155590 (21h56m3.521921325s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363401982 (21h56m3.522167716s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363656129 (21h56m3.522421863s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363894394 (21h56m3.522660128s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.364117371 (21h56m3.522883105s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:37.199272341 (21h56m4.358038065s) [upload=19174]: Next returned nil segment
Aug 26 13:59:37.199285717 (21h56m4.358051451s) [upload=19174]: Waiting for error group managing segments...
Aug 26 13:59:37.589580034 (21h56m4.748345758s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.594131703 (21h56m4.752897427s) [noise=true , address=81.171.14.70:4040 , piece_id=CLDSUJTU4J5UOXIQH2YSGQ433DNEVMSTPOMJVF2JNXQNFWCGIVYQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.596256668 (21h56m4.755022402s) [noise=true , address=81.171.14.70:4037 , piece_id=27ZPXRI23RUI54ICPP54BSSKJ2LE3PHOLJ4YBJLWSIHEBEVV7NBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.608940849 (21h56m4.767706583s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.611766345 (21h56m4.770532069s) [noise=true , address=81.171.14.70:4032 , piece_id=GQZ75ME37FRTKBRAJSINSL5NVJ4I2MYW7XQ5FXWSSE5RGMFUPNLA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.618286370 (21h56m4.777052105s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.624170670 (21h56m4.782936404s) [noise=true , address=81.171.14.70:4038 , piece_id=3W3A5FK6POPOZKVX4JENXWUCGPIN4IDXXLMRTWK7FFLJIULUVMPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.630168607 (21h56m4.788934341s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.632247794 (21h56m4.791013528s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.640167778 (21h56m4.798933502s) [noise=true , address=81.171.14.70:4044 , piece_id=R6GEYW6DRV342SKWI2WDDJ72YMYOTAHWKEAI2SVSCTVMLM5RCVSQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.645174348 (21h56m4.803940082s) [noise=true , address=89.149.201.147:4020 , piece_id=6UIQHU243AB4CXBFFHKWMSFEFRXYOUGCDYG2BJYCGEUCZLVC3HKA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.648180631 (21h56m4.806946365s) [noise=true , address=89.149.201.147:4019 , piece_id=6Y43IY5G76VKCSCEENP52G7MBIGUXYC3CXLLE6JSPD7OPZTFMNVA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.661047811 (21h56m4.819813545s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.666915147 (21h56m4.825680881s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.670273844 (21h56m4.829039578s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.684106131 (21h56m4.842871865s) [noise=true , address=89.149.201.147:4017 , piece_id=MKT3FFR4AEZJK5ZRT3I3NULCM5RV4GBHZIGJAUDYRQDUJZ2SV2YQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.692082484 (21h56m4.850848208s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.695714633 (21h56m4.854480367s) [noise=true , address=89.149.201.147:4008 , piece_id=USSJNCI3B7MPQGP6PFPXJDHXPXLA3M2SLGP64K55UDNUTX2G25GA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:38.155467373 (21h56m5.314233097s) [noise=true , address=89.149.201.147:4002 , piece_id=6I6IJHCFTFINP6LZIWEVK5D5HOPY6F3AYUIMJL5UKF35LFXUB2EQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.065060776 (21h56m6.2238265s) [noise=true , address=185.167.204.206:4056 , piece_id=2KMYS36C6EPZEJQ7ZTY2V36JIXMUILI2WLYV4YHWUIQ23VYNL5BA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.616533284 (21h56m6.775299018s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.032758157 (21h56m7.191523891s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.070167937 (21h56m7.228933671s) [noise=true , address=185.167.204.205:4021 , piece_id=O3XIS5F2XZ6ZBRVVFXVRNGK57X4QWAP2WLHITVV4PSWDV6U5PM2Q, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.359213894 (21h56m7.517979628s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:41.026303225 (21h56m8.185068959s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618556863 (21h56m9.777322597s) [noise=true , address=185.167.204.206:4047 , piece_id=BB7CSGKRZVX7XUSFR5RXVMBMYN7AXC6YPL6A3POOSPAPCPNNS3QQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618585117 (21h56m9.777350841s) [seg_pos={0 0}, upload=19174]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:59:42.618695368 (21h56m9.777461102s) [noise=true , address=185.167.204.205:4025 , piece_id=I2UPKQ3L2EZVJKSKRY752HJXNF54XNOFGGECQSZW4QA3BOHL6SBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618821689 (21h56m9.777587423s) [noise=true , address=185.167.204.205:4004 , piece_id=IDM75A5R46JRCRSNIQILR7LNUKZWG6S55GROJHB6D4CW4ARNWLHA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618860303 (21h56m9.777626037s) [seg_pos={0 0}, upload=19174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:59:42.618945466 (21h56m9.7777112s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:59:42.618949754 (21h56m9.777715478s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:59:42.868274237 (21h56m10.027039971s) [upload=19174]: Done uploading segments...
Aug 26 13:59:42.868294345 (21h56m10.027060079s) [upload=19174]: Upload finished. err: <nil>
Duration: 25.3384952s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
7.266731939s
FAIL (2025-08-26 14:02:17 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 7.266762669s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
21 out of 60 is failed (threshold=3) [................XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X..] duration:
50.747656154s
FAIL (2025-08-26 14:02:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
oad=19174]: Uploading piece...
Aug 26 13:59:36.361433005 (21h56m3.520198739s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361656342 (21h56m3.520422077s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361879810 (21h56m3.520645544s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362073460 (21h56m3.520839194s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362283903 (21h56m3.521049637s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362495227 (21h56m3.521260971s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362725538 (21h56m3.521491282s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362953544 (21h56m3.521719278s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363155590 (21h56m3.521921325s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363401982 (21h56m3.522167716s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363656129 (21h56m3.522421863s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363894394 (21h56m3.522660128s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.364117371 (21h56m3.522883105s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:37.199272341 (21h56m4.358038065s) [upload=19174]: Next returned nil segment
Aug 26 13:59:37.199285717 (21h56m4.358051451s) [upload=19174]: Waiting for error group managing segments...
Aug 26 13:59:37.589580034 (21h56m4.748345758s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.594131703 (21h56m4.752897427s) [noise=true , address=81.171.14.70:4040 , piece_id=CLDSUJTU4J5UOXIQH2YSGQ433DNEVMSTPOMJVF2JNXQNFWCGIVYQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.596256668 (21h56m4.755022402s) [noise=true , address=81.171.14.70:4037 , piece_id=27ZPXRI23RUI54ICPP54BSSKJ2LE3PHOLJ4YBJLWSIHEBEVV7NBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.608940849 (21h56m4.767706583s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.611766345 (21h56m4.770532069s) [noise=true , address=81.171.14.70:4032 , piece_id=GQZ75ME37FRTKBRAJSINSL5NVJ4I2MYW7XQ5FXWSSE5RGMFUPNLA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.618286370 (21h56m4.777052105s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.624170670 (21h56m4.782936404s) [noise=true , address=81.171.14.70:4038 , piece_id=3W3A5FK6POPOZKVX4JENXWUCGPIN4IDXXLMRTWK7FFLJIULUVMPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.630168607 (21h56m4.788934341s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.632247794 (21h56m4.791013528s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.640167778 (21h56m4.798933502s) [noise=true , address=81.171.14.70:4044 , piece_id=R6GEYW6DRV342SKWI2WDDJ72YMYOTAHWKEAI2SVSCTVMLM5RCVSQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.645174348 (21h56m4.803940082s) [noise=true , address=89.149.201.147:4020 , piece_id=6UIQHU243AB4CXBFFHKWMSFEFRXYOUGCDYG2BJYCGEUCZLVC3HKA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.648180631 (21h56m4.806946365s) [noise=true , address=89.149.201.147:4019 , piece_id=6Y43IY5G76VKCSCEENP52G7MBIGUXYC3CXLLE6JSPD7OPZTFMNVA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.661047811 (21h56m4.819813545s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.666915147 (21h56m4.825680881s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.670273844 (21h56m4.829039578s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.684106131 (21h56m4.842871865s) [noise=true , address=89.149.201.147:4017 , piece_id=MKT3FFR4AEZJK5ZRT3I3NULCM5RV4GBHZIGJAUDYRQDUJZ2SV2YQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.692082484 (21h56m4.850848208s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.695714633 (21h56m4.854480367s) [noise=true , address=89.149.201.147:4008 , piece_id=USSJNCI3B7MPQGP6PFPXJDHXPXLA3M2SLGP64K55UDNUTX2G25GA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:38.155467373 (21h56m5.314233097s) [noise=true , address=89.149.201.147:4002 , piece_id=6I6IJHCFTFINP6LZIWEVK5D5HOPY6F3AYUIMJL5UKF35LFXUB2EQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.065060776 (21h56m6.2238265s) [noise=true , address=185.167.204.206:4056 , piece_id=2KMYS36C6EPZEJQ7ZTY2V36JIXMUILI2WLYV4YHWUIQ23VYNL5BA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.616533284 (21h56m6.775299018s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.032758157 (21h56m7.191523891s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.070167937 (21h56m7.228933671s) [noise=true , address=185.167.204.205:4021 , piece_id=O3XIS5F2XZ6ZBRVVFXVRNGK57X4QWAP2WLHITVV4PSWDV6U5PM2Q, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.359213894 (21h56m7.517979628s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:41.026303225 (21h56m8.185068959s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618556863 (21h56m9.777322597s) [noise=true , address=185.167.204.206:4047 , piece_id=BB7CSGKRZVX7XUSFR5RXVMBMYN7AXC6YPL6A3POOSPAPCPNNS3QQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618585117 (21h56m9.777350841s) [seg_pos={0 0}, upload=19174]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:59:42.618695368 (21h56m9.777461102s) [noise=true , address=185.167.204.205:4025 , piece_id=I2UPKQ3L2EZVJKSKRY752HJXNF54XNOFGGECQSZW4QA3BOHL6SBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618821689 (21h56m9.777587423s) [noise=true , address=185.167.204.205:4004 , piece_id=IDM75A5R46JRCRSNIQILR7LNUKZWG6S55GROJHB6D4CW4ARNWLHA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618860303 (21h56m9.777626037s) [seg_pos={0 0}, upload=19174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:59:42.618945466 (21h56m9.7777112s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:59:42.618949754 (21h56m9.777715478s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:59:42.868274237 (21h56m10.027039971s) [upload=19174]: Done uploading segments...
Aug 26 13:59:42.868294345 (21h56m10.027060079s) [upload=19174]: Upload finished. err: <nil>
Duration: 50.747672586s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.873325653s
FAIL (2025-08-26 14:01:35 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 6.873357534s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
21 out of 60 is failed (threshold=3) [.................XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X.] duration:
40.663488936s
FAIL (2025-08-26 14:01:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
oad=19174]: Uploading piece...
Aug 26 13:59:36.361433005 (21h56m3.520198739s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361656342 (21h56m3.520422077s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361879810 (21h56m3.520645544s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362073460 (21h56m3.520839194s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362283903 (21h56m3.521049637s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362495227 (21h56m3.521260971s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362725538 (21h56m3.521491282s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362953544 (21h56m3.521719278s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363155590 (21h56m3.521921325s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363401982 (21h56m3.522167716s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363656129 (21h56m3.522421863s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363894394 (21h56m3.522660128s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.364117371 (21h56m3.522883105s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:37.199272341 (21h56m4.358038065s) [upload=19174]: Next returned nil segment
Aug 26 13:59:37.199285717 (21h56m4.358051451s) [upload=19174]: Waiting for error group managing segments...
Aug 26 13:59:37.589580034 (21h56m4.748345758s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.594131703 (21h56m4.752897427s) [noise=true , address=81.171.14.70:4040 , piece_id=CLDSUJTU4J5UOXIQH2YSGQ433DNEVMSTPOMJVF2JNXQNFWCGIVYQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.596256668 (21h56m4.755022402s) [noise=true , address=81.171.14.70:4037 , piece_id=27ZPXRI23RUI54ICPP54BSSKJ2LE3PHOLJ4YBJLWSIHEBEVV7NBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.608940849 (21h56m4.767706583s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.611766345 (21h56m4.770532069s) [noise=true , address=81.171.14.70:4032 , piece_id=GQZ75ME37FRTKBRAJSINSL5NVJ4I2MYW7XQ5FXWSSE5RGMFUPNLA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.618286370 (21h56m4.777052105s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.624170670 (21h56m4.782936404s) [noise=true , address=81.171.14.70:4038 , piece_id=3W3A5FK6POPOZKVX4JENXWUCGPIN4IDXXLMRTWK7FFLJIULUVMPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.630168607 (21h56m4.788934341s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.632247794 (21h56m4.791013528s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.640167778 (21h56m4.798933502s) [noise=true , address=81.171.14.70:4044 , piece_id=R6GEYW6DRV342SKWI2WDDJ72YMYOTAHWKEAI2SVSCTVMLM5RCVSQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.645174348 (21h56m4.803940082s) [noise=true , address=89.149.201.147:4020 , piece_id=6UIQHU243AB4CXBFFHKWMSFEFRXYOUGCDYG2BJYCGEUCZLVC3HKA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.648180631 (21h56m4.806946365s) [noise=true , address=89.149.201.147:4019 , piece_id=6Y43IY5G76VKCSCEENP52G7MBIGUXYC3CXLLE6JSPD7OPZTFMNVA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.661047811 (21h56m4.819813545s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.666915147 (21h56m4.825680881s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.670273844 (21h56m4.829039578s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.684106131 (21h56m4.842871865s) [noise=true , address=89.149.201.147:4017 , piece_id=MKT3FFR4AEZJK5ZRT3I3NULCM5RV4GBHZIGJAUDYRQDUJZ2SV2YQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.692082484 (21h56m4.850848208s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.695714633 (21h56m4.854480367s) [noise=true , address=89.149.201.147:4008 , piece_id=USSJNCI3B7MPQGP6PFPXJDHXPXLA3M2SLGP64K55UDNUTX2G25GA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:38.155467373 (21h56m5.314233097s) [noise=true , address=89.149.201.147:4002 , piece_id=6I6IJHCFTFINP6LZIWEVK5D5HOPY6F3AYUIMJL5UKF35LFXUB2EQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.065060776 (21h56m6.2238265s) [noise=true , address=185.167.204.206:4056 , piece_id=2KMYS36C6EPZEJQ7ZTY2V36JIXMUILI2WLYV4YHWUIQ23VYNL5BA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.616533284 (21h56m6.775299018s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.032758157 (21h56m7.191523891s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.070167937 (21h56m7.228933671s) [noise=true , address=185.167.204.205:4021 , piece_id=O3XIS5F2XZ6ZBRVVFXVRNGK57X4QWAP2WLHITVV4PSWDV6U5PM2Q, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.359213894 (21h56m7.517979628s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:41.026303225 (21h56m8.185068959s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618556863 (21h56m9.777322597s) [noise=true , address=185.167.204.206:4047 , piece_id=BB7CSGKRZVX7XUSFR5RXVMBMYN7AXC6YPL6A3POOSPAPCPNNS3QQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618585117 (21h56m9.777350841s) [seg_pos={0 0}, upload=19174]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:59:42.618695368 (21h56m9.777461102s) [noise=true , address=185.167.204.205:4025 , piece_id=I2UPKQ3L2EZVJKSKRY752HJXNF54XNOFGGECQSZW4QA3BOHL6SBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618821689 (21h56m9.777587423s) [noise=true , address=185.167.204.205:4004 , piece_id=IDM75A5R46JRCRSNIQILR7LNUKZWG6S55GROJHB6D4CW4ARNWLHA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618860303 (21h56m9.777626037s) [seg_pos={0 0}, upload=19174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:59:42.618945466 (21h56m9.7777112s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:59:42.618949754 (21h56m9.777715478s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:59:42.868274237 (21h56m10.027039971s) [upload=19174]: Done uploading segments...
Aug 26 13:59:42.868294345 (21h56m10.027060079s) [upload=19174]: Upload finished. err: <nil>
Duration: 40.663525777s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
7.048574134s
FAIL (2025-08-26 14:00:43 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 7.048608309s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
21 out of 60 is failed (threshold=3) [..................XXX...XX..XXXXXX......X.XX..XXX..X.X..X..X] duration:
1m0.003481703s
FAIL (2025-08-26 14:00:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
oad=19174]: Uploading piece...
Aug 26 13:59:36.361433005 (21h56m3.520198739s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361656342 (21h56m3.520422077s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.361879810 (21h56m3.520645544s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362073460 (21h56m3.520839194s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362283903 (21h56m3.521049637s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362495227 (21h56m3.521260971s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362725538 (21h56m3.521491282s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.362953544 (21h56m3.521719278s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363155590 (21h56m3.521921325s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363401982 (21h56m3.522167716s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363656129 (21h56m3.522421863s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.363894394 (21h56m3.522660128s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:36.364117371 (21h56m3.522883105s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Uploading piece...
Aug 26 13:59:37.199272341 (21h56m4.358038065s) [upload=19174]: Next returned nil segment
Aug 26 13:59:37.199285717 (21h56m4.358051451s) [upload=19174]: Waiting for error group managing segments...
Aug 26 13:59:37.589580034 (21h56m4.748345758s) [noise=true , address=81.171.14.70:4030 , piece_id=5GIWHDVQPNB672P47EQOFQUKZBOPBIUE5YXNYGVP6VHYMBZEFCRA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.594131703 (21h56m4.752897427s) [noise=true , address=81.171.14.70:4040 , piece_id=CLDSUJTU4J5UOXIQH2YSGQ433DNEVMSTPOMJVF2JNXQNFWCGIVYQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.596256668 (21h56m4.755022402s) [noise=true , address=81.171.14.70:4037 , piece_id=27ZPXRI23RUI54ICPP54BSSKJ2LE3PHOLJ4YBJLWSIHEBEVV7NBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.608940849 (21h56m4.767706583s) [noise=true , address=81.171.14.70:4041 , piece_id=TH3SJDUJSTZW2HUYMFZUTLL47NHFQ6PR62CT3VZTMDEQA5CIDORA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.611766345 (21h56m4.770532069s) [noise=true , address=81.171.14.70:4032 , piece_id=GQZ75ME37FRTKBRAJSINSL5NVJ4I2MYW7XQ5FXWSSE5RGMFUPNLA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.618286370 (21h56m4.777052105s) [noise=true , address=81.171.14.70:4031 , piece_id=XJQDEJKFG5BORY6XFUBYQYOSDG33NMHJIQFNPRONIU7KA4RO72IA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.624170670 (21h56m4.782936404s) [noise=true , address=81.171.14.70:4038 , piece_id=3W3A5FK6POPOZKVX4JENXWUCGPIN4IDXXLMRTWK7FFLJIULUVMPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.630168607 (21h56m4.788934341s) [noise=true , address=81.171.14.70:4048 , piece_id=SUTQBTSW3RK4WKAU2HZWMPXE7FJWSO4RN3L5G7EJNAWKXQIB4VFQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.632247794 (21h56m4.791013528s) [noise=true , address=89.149.201.147:4013 , piece_id=BIP5KBOXHDGM2RD5ZVXJTU46CP327TB5JQQ4HA4YHKCGTEGV3BPQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.640167778 (21h56m4.798933502s) [noise=true , address=81.171.14.70:4044 , piece_id=R6GEYW6DRV342SKWI2WDDJ72YMYOTAHWKEAI2SVSCTVMLM5RCVSQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.645174348 (21h56m4.803940082s) [noise=true , address=89.149.201.147:4020 , piece_id=6UIQHU243AB4CXBFFHKWMSFEFRXYOUGCDYG2BJYCGEUCZLVC3HKA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.648180631 (21h56m4.806946365s) [noise=true , address=89.149.201.147:4019 , piece_id=6Y43IY5G76VKCSCEENP52G7MBIGUXYC3CXLLE6JSPD7OPZTFMNVA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.661047811 (21h56m4.819813545s) [noise=true , address=89.149.201.147:4024 , piece_id=5JXZ2NEXRSFJ2PYPU75YNBYFAWYZF35YZWSW7YVLMESIJTDQHABA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.666915147 (21h56m4.825680881s) [noise=true , address=89.149.201.147:4011 , piece_id=G22ZNL4GMHZWYI22XG3L2JATNKOYS3A4CIINMWZPHAZLIJU3SKUA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.670273844 (21h56m4.829039578s) [noise=true , address=89.149.201.147:4004 , piece_id=L7YRWYO36E7VSU4SLLKMD4QEQVZN6KJOOP6M2UHWR4MKF6LLI4SQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.684106131 (21h56m4.842871865s) [noise=true , address=89.149.201.147:4017 , piece_id=MKT3FFR4AEZJK5ZRT3I3NULCM5RV4GBHZIGJAUDYRQDUJZ2SV2YQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.692082484 (21h56m4.850848208s) [noise=true , address=89.149.201.147:4014 , piece_id=RF4PB5Q2UAF277T3JULF7G4GG44UKY4NIKA2T6NF6SG4U7G7BTTQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:37.695714633 (21h56m4.854480367s) [noise=true , address=89.149.201.147:4008 , piece_id=USSJNCI3B7MPQGP6PFPXJDHXPXLA3M2SLGP64K55UDNUTX2G25GA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:38.155467373 (21h56m5.314233097s) [noise=true , address=89.149.201.147:4002 , piece_id=6I6IJHCFTFINP6LZIWEVK5D5HOPY6F3AYUIMJL5UKF35LFXUB2EQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.065060776 (21h56m6.2238265s) [noise=true , address=185.167.204.206:4056 , piece_id=2KMYS36C6EPZEJQ7ZTY2V36JIXMUILI2WLYV4YHWUIQ23VYNL5BA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:39.616533284 (21h56m6.775299018s) [noise=true , address=185.167.204.206:4060 , piece_id=T6EDL6IBXUYYVFNEDQXS5C2QJGINHWEJEEYAU6PSM2KQUEAUAIXA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.032758157 (21h56m7.191523891s) [noise=true , address=185.167.204.205:4032 , piece_id=HEAZWEASFTUJGRYBE36XIQK6WBO354754B3XJ3UDGIUCW6EPQUKQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.070167937 (21h56m7.228933671s) [noise=true , address=185.167.204.205:4021 , piece_id=O3XIS5F2XZ6ZBRVVFXVRNGK57X4QWAP2WLHITVV4PSWDV6U5PM2Q, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:40.359213894 (21h56m7.517979628s) [noise=true , address=185.167.204.205:4008 , piece_id=UDPY3LTZHPIIKA5ZCX4PSYLZLQB4WGZWAMRQ3B3VDWWKBPXUZRIQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:41.026303225 (21h56m8.185068959s) [noise=true , address=185.167.204.206:4055 , piece_id=FF6TEEMBTNHZQV6HGQZSHZ3VO5QBNNRBLDL6WYNISL3GQCMHMJLQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618556863 (21h56m9.777322597s) [noise=true , address=185.167.204.206:4047 , piece_id=BB7CSGKRZVX7XUSFR5RXVMBMYN7AXC6YPL6A3POOSPAPCPNNS3QQ, seg_pos={0 0}, upload=19174]: Done uploading piece. err: <nil>
Aug 26 13:59:42.618585117 (21h56m9.777350841s) [seg_pos={0 0}, upload=19174]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:59:42.618695368 (21h56m9.777461102s) [noise=true , address=185.167.204.205:4025 , piece_id=I2UPKQ3L2EZVJKSKRY752HJXNF54XNOFGGECQSZW4QA3BOHL6SBA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618821689 (21h56m9.777587423s) [noise=true , address=185.167.204.205:4004 , piece_id=IDM75A5R46JRCRSNIQILR7LNUKZWG6S55GROJHB6D4CW4ARNWLHA, seg_pos={0 0}, upload=19174]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Aug 26 13:59:42.618860303 (21h56m9.777626037s) [seg_pos={0 0}, upload=19174]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:59:42.618945466 (21h56m9.7777112s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:59:42.618949754 (21h56m9.777715478s) [upload=19174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:59:42.868274237 (21h56m10.027039971s) [upload=19174]: Done uploading segments...
Aug 26 13:59:42.868294345 (21h56m10.027060079s) [upload=19174]: Upload finished. err: <nil>
Duration: 1m0.003507932s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.48798233s
FAIL (2025-08-26 13:59:57 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 5.488008951s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.998663636s
FAIL (2025-08-26 13:59:35 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 5.998716709s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
20 out of 60 is failed (threshold=3) [...................XXX...XX..XXXXXX......X.XX..XXX..X.X..X..] duration:
19.48921514s
FAIL (2025-08-26 13:59:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.322746048 (21h53m34.481511782s) [noise=true , address=185.167.204.206:4068 , piece_id=Y76VKVC5N7ARBB4TTRBESM7QIUNYKX3OR3MXO3FF2KUNVJ34TXJQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.322991458 (21h53m34.481757192s) [noise=true , address=81.171.14.70:4031 , piece_id=7UEZFMU43E3CWH3ULSMLRRAX2NRNXSYTEX5ZX5KG64D3PFEAXH3A, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323001847 (21h53m34.481767581s) [noise=true , address=185.167.204.205:4032 , piece_id=DM2LSK4K6F4HIFDNULSKDFTSNFRF3VFWF676TMA3XM4H5IDN3SAQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323250663 (21h53m34.482016407s) [noise=true , address=185.167.204.206:4038 , piece_id=RHBXPUQ774LAEMA56J6NUKKSFVQQQS5DUYAF6IUC57QJWNVB4XLQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323298265 (21h53m34.482063999s) [noise=true , address=185.167.204.206:4069 , piece_id=LMS7S4ILZJAOS3ZLSVGE7QXPBCVGWQVAMFM3TZNSAV56BD27BZ2A, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323535118 (21h53m34.482300852s) [noise=true , address=81.171.14.70:4030 , piece_id=FFCXMF577LP34HYFKPCVB3B3QF63W5T5JRLLKPLT2LMOH7SG6BQA, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323789525 (21h53m34.482555259s) [noise=true , address=89.149.201.147:4009 , piece_id=AK4LKV2JPGYSETJNW2AEM6QOM6SM5CO5NMXW2566L5N2GLOQ5VYQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324070362 (21h53m34.482836096s) [noise=true , address=81.171.14.70:4041 , piece_id=INKAO7LCG7427OA6J627YUQ3BN23IGMRD5VBUEQGD5H6ABPJ6TQA, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324314369 (21h53m34.483080103s) [noise=true , address=185.167.204.206:4072 , piece_id=RBIJB5IXFINHGPRR5KFKIVK56EV6LKHAFWDLDM46GYU53UL5FDIA, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324553907 (21h53m34.483319641s) [noise=true , address=89.149.201.147:4016 , piece_id=P3SZ3OFNX2V6DGJUNJE5UDDOCT3P4KTZ7JYAUNCPLQ5RJKUFYCTQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324794498 (21h53m34.483560232s) [noise=true , address=185.167.204.206:4053 , piece_id=J5TMQGF6KQ36E2RHSQH7QWOK2TAW4OU5PJDYTLGI4UUXIXALRLUQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.325024317 (21h53m34.483790051s) [noise=true , address=185.167.204.206:4041 , piece_id=H524KFBBBGDFVXN7IEHEYEGRXKHMWTE5OFQTYQKGB62DOIASJVPQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.325272713 (21h53m34.484038447s) [noise=true , address=185.167.204.206:4037 , piece_id=MIR3AKL2ZF3A77WURTTI7ZKPPXHW2N6F62ENPA7DXAWJFYO7XJ3A, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:08.161434739 (21h53m35.320200473s) [upload=19138]: Next returned nil segment
Aug 26 13:57:08.161451511 (21h53m35.320217245s) [upload=19138]: Waiting for error group managing segments...
Aug 26 13:57:08.560326546 (21h53m35.71909228s) [noise=true , address=81.171.14.70:4036 , piece_id=BB4LWJ3YIULQF2KGGUSKJ3X3KC27AFO5ELZ3EJZ6GKKQGBRPAOHA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.572051190 (21h53m35.730816924s) [noise=true , address=89.149.201.147:4002 , piece_id=W3FJ34UMDVAJVCIAU7IRV4QRUOCNWVXVYQJDC5L7RIIIRQWZOIOA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.576298687 (21h53m35.735064411s) [noise=true , address=81.171.14.70:4027 , piece_id=7NU2E73FZKO5K2Q2MVTV4ZSLAWZIDUJ2WMRD6DYRAEHDQ26OCZUA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.577574920 (21h53m35.736340654s) [noise=true , address=81.171.14.70:4030 , piece_id=FFCXMF577LP34HYFKPCVB3B3QF63W5T5JRLLKPLT2LMOH7SG6BQA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.581750809 (21h53m35.740516543s) [noise=true , address=89.149.201.147:4021 , piece_id=N3Q7DTB6TYHSBJVKRF3MTJIGC7GA7EDFR7B54U4PHM7T22O4B2XA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.584371845 (21h53m35.743137579s) [noise=true , address=89.149.201.147:4016 , piece_id=P3SZ3OFNX2V6DGJUNJE5UDDOCT3P4KTZ7JYAUNCPLQ5RJKUFYCTQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.599555447 (21h53m35.758321182s) [noise=true , address=81.171.14.70:4040 , piece_id=HAL6CPNUZCEZAKD3R3IFMBH5HOIFG6R2DTXBOJ3KZH3KU6DQ5WCQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.600096131 (21h53m35.758861865s) [noise=true , address=81.171.14.70:4025 , piece_id=R6VOEHXVZUKEOYOPVQGLM4WD4N3CFVS3SGHLGODDR3Q6MBMOYCBQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.600112633 (21h53m35.758878357s) [noise=true , address=81.171.14.70:4038 , piece_id=GXONJBH26JXJZ54SRCOF6ZYFUVCX4RVD3LRSY2KMLCXM53TGT7ZQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.624116633 (21h53m35.782882367s) [noise=true , address=89.149.201.147:4007 , piece_id=ROZYFBJPJOB6SDVNIDVEEQGG7QKUA7ERHCUFLHHCVXCSC7FGADLQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.628558492 (21h53m35.787324216s) [noise=true , address=89.149.201.147:4009 , piece_id=AK4LKV2JPGYSETJNW2AEM6QOM6SM5CO5NMXW2566L5N2GLOQ5VYQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.659697644 (21h53m35.818463378s) [noise=true , address=81.171.14.70:4041 , piece_id=INKAO7LCG7427OA6J627YUQ3BN23IGMRD5VBUEQGD5H6ABPJ6TQA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:09.025038694 (21h53m36.183804428s) [noise=true , address=81.171.14.70:4031 , piece_id=7UEZFMU43E3CWH3ULSMLRRAX2NRNXSYTEX5ZX5KG64D3PFEAXH3A, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:09.048481330 (21h53m36.207247064s) [noise=true , address=89.149.201.147:4010 , piece_id=LBIXHO3OSCJVTXQOFANQFZAC36QMLIEWCONROZEUTWXVB52ON6QQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.078415336 (21h53m37.23718107s) [noise=true , address=185.167.204.205:4019 , piece_id=RKTLHCZHQ37F2TXJ4LVL5S4V6VXF2M7X5AHJAKLVFEYSIVKQJIHA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.094377398 (21h53m37.253143132s) [noise=true , address=185.167.204.206:4072 , piece_id=RBIJB5IXFINHGPRR5KFKIVK56EV6LKHAFWDLDM46GYU53UL5FDIA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.203190603 (21h53m37.361956337s) [noise=true , address=185.167.204.206:4038 , piece_id=RHBXPUQ774LAEMA56J6NUKKSFVQQQS5DUYAF6IUC57QJWNVB4XLQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.781910867 (21h53m37.940676591s) [noise=true , address=185.167.204.205:4004 , piece_id=DXIDRMALUNWZQVOZXRLEOCSNRX2CH3JDPTUSVPZMOCOSMDIINIDA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.876111192 (21h53m38.034876916s) [noise=true , address=185.167.204.206:4053 , piece_id=J5TMQGF6KQ36E2RHSQH7QWOK2TAW4OU5PJDYTLGI4UUXIXALRLUQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:11.540437406 (21h53m38.69920313s) [noise=true , address=185.167.204.206:4057 , piece_id=ORML7OF7O6KWP5IDHGBHZZYYVY4ZVMKS6QY34KGZPLKRL2FE5SHA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:12.467810079 (21h53m39.626575813s) [noise=true , address=185.167.204.205:4010 , piece_id=BIGV526RX5NR3QAYCO7YHA4VFJ7MDEQABKY26X5T2P7I24SCIAZQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:14.493886321 (21h53m41.652652055s) [noise=true , address=185.167.204.206:4037 , piece_id=MIR3AKL2ZF3A77WURTTI7ZKPPXHW2N6F62ENPA7DXAWJFYO7XJ3A, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:14.689564084 (21h53m41.848329818s) [noise=true , address=185.167.204.206:4068 , piece_id=Y76VKVC5N7ARBB4TTRBESM7QIUNYKX3OR3MXO3FF2KUNVJ34TXJQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:14.825164966 (21h53m41.9839307s) [noise=true , address=185.167.204.205:4036 , piece_id=XR5R3LFRTZQKHP5Y4DNRGZDA665WLDTQAKVL24A3DUPXWKE7OPPQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:15.239297775 (21h53m42.398063509s) [noise=true , address=185.167.204.206:4041 , piece_id=H524KFBBBGDFVXN7IEHEYEGRXKHMWTE5OFQTYQKGB62DOIASJVPQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:15.295495384 (21h53m42.454261118s) [noise=true , address=185.167.204.206:4061 , piece_id=DMS765EZICQFESXYDX5EFMIE4CGDM422RAD5F45GP7D2UOKPHFYA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:15.295520673 (21h53m42.454286407s) [seg_pos={0 0}, upload=19138]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:57:15.295640953 (21h53m42.454406687s) [noise=true , address=185.167.204.206:4069 , piece_id=LMS7S4ILZJAOS3ZLSVGE7QXPBCVGWQVAMFM3TZNSAV56BD27BZ2A, seg_pos={0 0}, upload=19138]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF
Aug 26 13:57:15.295690838 (21h53m42.454456572s) [noise=true , address=185.167.204.205:4032 , piece_id=DM2LSK4K6F4HIFDNULSKDFTSNFRF3VFWF676TMA3XM4H5IDN3SAQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Aug 26 13:57:15.295700177 (21h53m42.454465911s) [seg_pos={0 0}, upload=19138]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:57:15.295759270 (21h53m42.454525004s) [upload=19138]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:57:15.295762937 (21h53m42.454528671s) [upload=19138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:57:15.566524136 (21h53m42.72528987s) [upload=19138]: Done uploading segments...
Aug 26 13:57:15.566547190 (21h53m42.725312924s) [upload=19138]: Upload finished. err: <nil>
Duration: 19.489232283s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.904090466s
FAIL (2025-08-26 13:58:42 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 6.904120403s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
20 out of 60 is failed (threshold=3) [....................XXX...XX..XXXXXX......X.XX..XXX..X.X..X.] duration:
35.930151988s
FAIL (2025-08-26 13:58:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.322746048 (21h53m34.481511782s) [noise=true , address=185.167.204.206:4068 , piece_id=Y76VKVC5N7ARBB4TTRBESM7QIUNYKX3OR3MXO3FF2KUNVJ34TXJQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.322991458 (21h53m34.481757192s) [noise=true , address=81.171.14.70:4031 , piece_id=7UEZFMU43E3CWH3ULSMLRRAX2NRNXSYTEX5ZX5KG64D3PFEAXH3A, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323001847 (21h53m34.481767581s) [noise=true , address=185.167.204.205:4032 , piece_id=DM2LSK4K6F4HIFDNULSKDFTSNFRF3VFWF676TMA3XM4H5IDN3SAQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323250663 (21h53m34.482016407s) [noise=true , address=185.167.204.206:4038 , piece_id=RHBXPUQ774LAEMA56J6NUKKSFVQQQS5DUYAF6IUC57QJWNVB4XLQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323298265 (21h53m34.482063999s) [noise=true , address=185.167.204.206:4069 , piece_id=LMS7S4ILZJAOS3ZLSVGE7QXPBCVGWQVAMFM3TZNSAV56BD27BZ2A, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323535118 (21h53m34.482300852s) [noise=true , address=81.171.14.70:4030 , piece_id=FFCXMF577LP34HYFKPCVB3B3QF63W5T5JRLLKPLT2LMOH7SG6BQA, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323789525 (21h53m34.482555259s) [noise=true , address=89.149.201.147:4009 , piece_id=AK4LKV2JPGYSETJNW2AEM6QOM6SM5CO5NMXW2566L5N2GLOQ5VYQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324070362 (21h53m34.482836096s) [noise=true , address=81.171.14.70:4041 , piece_id=INKAO7LCG7427OA6J627YUQ3BN23IGMRD5VBUEQGD5H6ABPJ6TQA, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324314369 (21h53m34.483080103s) [noise=true , address=185.167.204.206:4072 , piece_id=RBIJB5IXFINHGPRR5KFKIVK56EV6LKHAFWDLDM46GYU53UL5FDIA, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324553907 (21h53m34.483319641s) [noise=true , address=89.149.201.147:4016 , piece_id=P3SZ3OFNX2V6DGJUNJE5UDDOCT3P4KTZ7JYAUNCPLQ5RJKUFYCTQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324794498 (21h53m34.483560232s) [noise=true , address=185.167.204.206:4053 , piece_id=J5TMQGF6KQ36E2RHSQH7QWOK2TAW4OU5PJDYTLGI4UUXIXALRLUQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.325024317 (21h53m34.483790051s) [noise=true , address=185.167.204.206:4041 , piece_id=H524KFBBBGDFVXN7IEHEYEGRXKHMWTE5OFQTYQKGB62DOIASJVPQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.325272713 (21h53m34.484038447s) [noise=true , address=185.167.204.206:4037 , piece_id=MIR3AKL2ZF3A77WURTTI7ZKPPXHW2N6F62ENPA7DXAWJFYO7XJ3A, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:08.161434739 (21h53m35.320200473s) [upload=19138]: Next returned nil segment
Aug 26 13:57:08.161451511 (21h53m35.320217245s) [upload=19138]: Waiting for error group managing segments...
Aug 26 13:57:08.560326546 (21h53m35.71909228s) [noise=true , address=81.171.14.70:4036 , piece_id=BB4LWJ3YIULQF2KGGUSKJ3X3KC27AFO5ELZ3EJZ6GKKQGBRPAOHA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.572051190 (21h53m35.730816924s) [noise=true , address=89.149.201.147:4002 , piece_id=W3FJ34UMDVAJVCIAU7IRV4QRUOCNWVXVYQJDC5L7RIIIRQWZOIOA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.576298687 (21h53m35.735064411s) [noise=true , address=81.171.14.70:4027 , piece_id=7NU2E73FZKO5K2Q2MVTV4ZSLAWZIDUJ2WMRD6DYRAEHDQ26OCZUA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.577574920 (21h53m35.736340654s) [noise=true , address=81.171.14.70:4030 , piece_id=FFCXMF577LP34HYFKPCVB3B3QF63W5T5JRLLKPLT2LMOH7SG6BQA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.581750809 (21h53m35.740516543s) [noise=true , address=89.149.201.147:4021 , piece_id=N3Q7DTB6TYHSBJVKRF3MTJIGC7GA7EDFR7B54U4PHM7T22O4B2XA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.584371845 (21h53m35.743137579s) [noise=true , address=89.149.201.147:4016 , piece_id=P3SZ3OFNX2V6DGJUNJE5UDDOCT3P4KTZ7JYAUNCPLQ5RJKUFYCTQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.599555447 (21h53m35.758321182s) [noise=true , address=81.171.14.70:4040 , piece_id=HAL6CPNUZCEZAKD3R3IFMBH5HOIFG6R2DTXBOJ3KZH3KU6DQ5WCQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.600096131 (21h53m35.758861865s) [noise=true , address=81.171.14.70:4025 , piece_id=R6VOEHXVZUKEOYOPVQGLM4WD4N3CFVS3SGHLGODDR3Q6MBMOYCBQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.600112633 (21h53m35.758878357s) [noise=true , address=81.171.14.70:4038 , piece_id=GXONJBH26JXJZ54SRCOF6ZYFUVCX4RVD3LRSY2KMLCXM53TGT7ZQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.624116633 (21h53m35.782882367s) [noise=true , address=89.149.201.147:4007 , piece_id=ROZYFBJPJOB6SDVNIDVEEQGG7QKUA7ERHCUFLHHCVXCSC7FGADLQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.628558492 (21h53m35.787324216s) [noise=true , address=89.149.201.147:4009 , piece_id=AK4LKV2JPGYSETJNW2AEM6QOM6SM5CO5NMXW2566L5N2GLOQ5VYQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.659697644 (21h53m35.818463378s) [noise=true , address=81.171.14.70:4041 , piece_id=INKAO7LCG7427OA6J627YUQ3BN23IGMRD5VBUEQGD5H6ABPJ6TQA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:09.025038694 (21h53m36.183804428s) [noise=true , address=81.171.14.70:4031 , piece_id=7UEZFMU43E3CWH3ULSMLRRAX2NRNXSYTEX5ZX5KG64D3PFEAXH3A, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:09.048481330 (21h53m36.207247064s) [noise=true , address=89.149.201.147:4010 , piece_id=LBIXHO3OSCJVTXQOFANQFZAC36QMLIEWCONROZEUTWXVB52ON6QQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.078415336 (21h53m37.23718107s) [noise=true , address=185.167.204.205:4019 , piece_id=RKTLHCZHQ37F2TXJ4LVL5S4V6VXF2M7X5AHJAKLVFEYSIVKQJIHA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.094377398 (21h53m37.253143132s) [noise=true , address=185.167.204.206:4072 , piece_id=RBIJB5IXFINHGPRR5KFKIVK56EV6LKHAFWDLDM46GYU53UL5FDIA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.203190603 (21h53m37.361956337s) [noise=true , address=185.167.204.206:4038 , piece_id=RHBXPUQ774LAEMA56J6NUKKSFVQQQS5DUYAF6IUC57QJWNVB4XLQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.781910867 (21h53m37.940676591s) [noise=true , address=185.167.204.205:4004 , piece_id=DXIDRMALUNWZQVOZXRLEOCSNRX2CH3JDPTUSVPZMOCOSMDIINIDA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.876111192 (21h53m38.034876916s) [noise=true , address=185.167.204.206:4053 , piece_id=J5TMQGF6KQ36E2RHSQH7QWOK2TAW4OU5PJDYTLGI4UUXIXALRLUQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:11.540437406 (21h53m38.69920313s) [noise=true , address=185.167.204.206:4057 , piece_id=ORML7OF7O6KWP5IDHGBHZZYYVY4ZVMKS6QY34KGZPLKRL2FE5SHA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:12.467810079 (21h53m39.626575813s) [noise=true , address=185.167.204.205:4010 , piece_id=BIGV526RX5NR3QAYCO7YHA4VFJ7MDEQABKY26X5T2P7I24SCIAZQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:14.493886321 (21h53m41.652652055s) [noise=true , address=185.167.204.206:4037 , piece_id=MIR3AKL2ZF3A77WURTTI7ZKPPXHW2N6F62ENPA7DXAWJFYO7XJ3A, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:14.689564084 (21h53m41.848329818s) [noise=true , address=185.167.204.206:4068 , piece_id=Y76VKVC5N7ARBB4TTRBESM7QIUNYKX3OR3MXO3FF2KUNVJ34TXJQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:14.825164966 (21h53m41.9839307s) [noise=true , address=185.167.204.205:4036 , piece_id=XR5R3LFRTZQKHP5Y4DNRGZDA665WLDTQAKVL24A3DUPXWKE7OPPQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:15.239297775 (21h53m42.398063509s) [noise=true , address=185.167.204.206:4041 , piece_id=H524KFBBBGDFVXN7IEHEYEGRXKHMWTE5OFQTYQKGB62DOIASJVPQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:15.295495384 (21h53m42.454261118s) [noise=true , address=185.167.204.206:4061 , piece_id=DMS765EZICQFESXYDX5EFMIE4CGDM422RAD5F45GP7D2UOKPHFYA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:15.295520673 (21h53m42.454286407s) [seg_pos={0 0}, upload=19138]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:57:15.295640953 (21h53m42.454406687s) [noise=true , address=185.167.204.206:4069 , piece_id=LMS7S4ILZJAOS3ZLSVGE7QXPBCVGWQVAMFM3TZNSAV56BD27BZ2A, seg_pos={0 0}, upload=19138]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF
Aug 26 13:57:15.295690838 (21h53m42.454456572s) [noise=true , address=185.167.204.205:4032 , piece_id=DM2LSK4K6F4HIFDNULSKDFTSNFRF3VFWF676TMA3XM4H5IDN3SAQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Aug 26 13:57:15.295700177 (21h53m42.454465911s) [seg_pos={0 0}, upload=19138]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:57:15.295759270 (21h53m42.454525004s) [upload=19138]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:57:15.295762937 (21h53m42.454528671s) [upload=19138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:57:15.566524136 (21h53m42.72528987s) [upload=19138]: Done uploading segments...
Aug 26 13:57:15.566547190 (21h53m42.725312924s) [upload=19138]: Upload finished. err: <nil>
Duration: 35.930169292s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
20 out of 60 is failed (threshold=3) [.....................XXX...XX..XXXXXX......X.XX..XXX..X.X..X] duration:
1m0.004193718s
FAIL (2025-08-26 13:58:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.322746048 (21h53m34.481511782s) [noise=true , address=185.167.204.206:4068 , piece_id=Y76VKVC5N7ARBB4TTRBESM7QIUNYKX3OR3MXO3FF2KUNVJ34TXJQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.322991458 (21h53m34.481757192s) [noise=true , address=81.171.14.70:4031 , piece_id=7UEZFMU43E3CWH3ULSMLRRAX2NRNXSYTEX5ZX5KG64D3PFEAXH3A, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323001847 (21h53m34.481767581s) [noise=true , address=185.167.204.205:4032 , piece_id=DM2LSK4K6F4HIFDNULSKDFTSNFRF3VFWF676TMA3XM4H5IDN3SAQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323250663 (21h53m34.482016407s) [noise=true , address=185.167.204.206:4038 , piece_id=RHBXPUQ774LAEMA56J6NUKKSFVQQQS5DUYAF6IUC57QJWNVB4XLQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323298265 (21h53m34.482063999s) [noise=true , address=185.167.204.206:4069 , piece_id=LMS7S4ILZJAOS3ZLSVGE7QXPBCVGWQVAMFM3TZNSAV56BD27BZ2A, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323535118 (21h53m34.482300852s) [noise=true , address=81.171.14.70:4030 , piece_id=FFCXMF577LP34HYFKPCVB3B3QF63W5T5JRLLKPLT2LMOH7SG6BQA, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.323789525 (21h53m34.482555259s) [noise=true , address=89.149.201.147:4009 , piece_id=AK4LKV2JPGYSETJNW2AEM6QOM6SM5CO5NMXW2566L5N2GLOQ5VYQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324070362 (21h53m34.482836096s) [noise=true , address=81.171.14.70:4041 , piece_id=INKAO7LCG7427OA6J627YUQ3BN23IGMRD5VBUEQGD5H6ABPJ6TQA, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324314369 (21h53m34.483080103s) [noise=true , address=185.167.204.206:4072 , piece_id=RBIJB5IXFINHGPRR5KFKIVK56EV6LKHAFWDLDM46GYU53UL5FDIA, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324553907 (21h53m34.483319641s) [noise=true , address=89.149.201.147:4016 , piece_id=P3SZ3OFNX2V6DGJUNJE5UDDOCT3P4KTZ7JYAUNCPLQ5RJKUFYCTQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.324794498 (21h53m34.483560232s) [noise=true , address=185.167.204.206:4053 , piece_id=J5TMQGF6KQ36E2RHSQH7QWOK2TAW4OU5PJDYTLGI4UUXIXALRLUQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.325024317 (21h53m34.483790051s) [noise=true , address=185.167.204.206:4041 , piece_id=H524KFBBBGDFVXN7IEHEYEGRXKHMWTE5OFQTYQKGB62DOIASJVPQ, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:07.325272713 (21h53m34.484038447s) [noise=true , address=185.167.204.206:4037 , piece_id=MIR3AKL2ZF3A77WURTTI7ZKPPXHW2N6F62ENPA7DXAWJFYO7XJ3A, seg_pos={0 0}, upload=19138]: Uploading piece...
Aug 26 13:57:08.161434739 (21h53m35.320200473s) [upload=19138]: Next returned nil segment
Aug 26 13:57:08.161451511 (21h53m35.320217245s) [upload=19138]: Waiting for error group managing segments...
Aug 26 13:57:08.560326546 (21h53m35.71909228s) [noise=true , address=81.171.14.70:4036 , piece_id=BB4LWJ3YIULQF2KGGUSKJ3X3KC27AFO5ELZ3EJZ6GKKQGBRPAOHA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.572051190 (21h53m35.730816924s) [noise=true , address=89.149.201.147:4002 , piece_id=W3FJ34UMDVAJVCIAU7IRV4QRUOCNWVXVYQJDC5L7RIIIRQWZOIOA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.576298687 (21h53m35.735064411s) [noise=true , address=81.171.14.70:4027 , piece_id=7NU2E73FZKO5K2Q2MVTV4ZSLAWZIDUJ2WMRD6DYRAEHDQ26OCZUA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.577574920 (21h53m35.736340654s) [noise=true , address=81.171.14.70:4030 , piece_id=FFCXMF577LP34HYFKPCVB3B3QF63W5T5JRLLKPLT2LMOH7SG6BQA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.581750809 (21h53m35.740516543s) [noise=true , address=89.149.201.147:4021 , piece_id=N3Q7DTB6TYHSBJVKRF3MTJIGC7GA7EDFR7B54U4PHM7T22O4B2XA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.584371845 (21h53m35.743137579s) [noise=true , address=89.149.201.147:4016 , piece_id=P3SZ3OFNX2V6DGJUNJE5UDDOCT3P4KTZ7JYAUNCPLQ5RJKUFYCTQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.599555447 (21h53m35.758321182s) [noise=true , address=81.171.14.70:4040 , piece_id=HAL6CPNUZCEZAKD3R3IFMBH5HOIFG6R2DTXBOJ3KZH3KU6DQ5WCQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.600096131 (21h53m35.758861865s) [noise=true , address=81.171.14.70:4025 , piece_id=R6VOEHXVZUKEOYOPVQGLM4WD4N3CFVS3SGHLGODDR3Q6MBMOYCBQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.600112633 (21h53m35.758878357s) [noise=true , address=81.171.14.70:4038 , piece_id=GXONJBH26JXJZ54SRCOF6ZYFUVCX4RVD3LRSY2KMLCXM53TGT7ZQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.624116633 (21h53m35.782882367s) [noise=true , address=89.149.201.147:4007 , piece_id=ROZYFBJPJOB6SDVNIDVEEQGG7QKUA7ERHCUFLHHCVXCSC7FGADLQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.628558492 (21h53m35.787324216s) [noise=true , address=89.149.201.147:4009 , piece_id=AK4LKV2JPGYSETJNW2AEM6QOM6SM5CO5NMXW2566L5N2GLOQ5VYQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:08.659697644 (21h53m35.818463378s) [noise=true , address=81.171.14.70:4041 , piece_id=INKAO7LCG7427OA6J627YUQ3BN23IGMRD5VBUEQGD5H6ABPJ6TQA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:09.025038694 (21h53m36.183804428s) [noise=true , address=81.171.14.70:4031 , piece_id=7UEZFMU43E3CWH3ULSMLRRAX2NRNXSYTEX5ZX5KG64D3PFEAXH3A, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:09.048481330 (21h53m36.207247064s) [noise=true , address=89.149.201.147:4010 , piece_id=LBIXHO3OSCJVTXQOFANQFZAC36QMLIEWCONROZEUTWXVB52ON6QQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.078415336 (21h53m37.23718107s) [noise=true , address=185.167.204.205:4019 , piece_id=RKTLHCZHQ37F2TXJ4LVL5S4V6VXF2M7X5AHJAKLVFEYSIVKQJIHA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.094377398 (21h53m37.253143132s) [noise=true , address=185.167.204.206:4072 , piece_id=RBIJB5IXFINHGPRR5KFKIVK56EV6LKHAFWDLDM46GYU53UL5FDIA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.203190603 (21h53m37.361956337s) [noise=true , address=185.167.204.206:4038 , piece_id=RHBXPUQ774LAEMA56J6NUKKSFVQQQS5DUYAF6IUC57QJWNVB4XLQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.781910867 (21h53m37.940676591s) [noise=true , address=185.167.204.205:4004 , piece_id=DXIDRMALUNWZQVOZXRLEOCSNRX2CH3JDPTUSVPZMOCOSMDIINIDA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:10.876111192 (21h53m38.034876916s) [noise=true , address=185.167.204.206:4053 , piece_id=J5TMQGF6KQ36E2RHSQH7QWOK2TAW4OU5PJDYTLGI4UUXIXALRLUQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:11.540437406 (21h53m38.69920313s) [noise=true , address=185.167.204.206:4057 , piece_id=ORML7OF7O6KWP5IDHGBHZZYYVY4ZVMKS6QY34KGZPLKRL2FE5SHA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:12.467810079 (21h53m39.626575813s) [noise=true , address=185.167.204.205:4010 , piece_id=BIGV526RX5NR3QAYCO7YHA4VFJ7MDEQABKY26X5T2P7I24SCIAZQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:14.493886321 (21h53m41.652652055s) [noise=true , address=185.167.204.206:4037 , piece_id=MIR3AKL2ZF3A77WURTTI7ZKPPXHW2N6F62ENPA7DXAWJFYO7XJ3A, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:14.689564084 (21h53m41.848329818s) [noise=true , address=185.167.204.206:4068 , piece_id=Y76VKVC5N7ARBB4TTRBESM7QIUNYKX3OR3MXO3FF2KUNVJ34TXJQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:14.825164966 (21h53m41.9839307s) [noise=true , address=185.167.204.205:4036 , piece_id=XR5R3LFRTZQKHP5Y4DNRGZDA665WLDTQAKVL24A3DUPXWKE7OPPQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:15.239297775 (21h53m42.398063509s) [noise=true , address=185.167.204.206:4041 , piece_id=H524KFBBBGDFVXN7IEHEYEGRXKHMWTE5OFQTYQKGB62DOIASJVPQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:15.295495384 (21h53m42.454261118s) [noise=true , address=185.167.204.206:4061 , piece_id=DMS765EZICQFESXYDX5EFMIE4CGDM422RAD5F45GP7D2UOKPHFYA, seg_pos={0 0}, upload=19138]: Done uploading piece. err: <nil>
Aug 26 13:57:15.295520673 (21h53m42.454286407s) [seg_pos={0 0}, upload=19138]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:57:15.295640953 (21h53m42.454406687s) [noise=true , address=185.167.204.206:4069 , piece_id=LMS7S4ILZJAOS3ZLSVGE7QXPBCVGWQVAMFM3TZNSAV56BD27BZ2A, seg_pos={0 0}, upload=19138]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF
Aug 26 13:57:15.295690838 (21h53m42.454456572s) [noise=true , address=185.167.204.205:4032 , piece_id=DM2LSK4K6F4HIFDNULSKDFTSNFRF3VFWF676TMA3XM4H5IDN3SAQ, seg_pos={0 0}, upload=19138]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN): protocol: expected piece hash; context canceled; EOF
Aug 26 13:57:15.295700177 (21h53m42.454465911s) [seg_pos={0 0}, upload=19138]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:57:15.295759270 (21h53m42.454525004s) [upload=19138]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:57:15.295762937 (21h53m42.454528671s) [upload=19138]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:57:15.566524136 (21h53m42.72528987s) [upload=19138]: Done uploading segments...
Aug 26 13:57:15.566547190 (21h53m42.725312924s) [upload=19138]: Upload finished. err: <nil>
Duration: 1m0.004224486s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
7.928029703s
FAIL (2025-08-26 13:57:59 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 7.928059279s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
19 out of 60 is failed (threshold=3) [......................XXX...XX..XXXXXX......X.XX..XXX..X.X..] duration:
42.88618461s
FAIL (2025-08-26 13:56:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
upload=19099]: Uploading piece...
Aug 26 13:54:01.888296215 (21h50m29.047061959s) [noise=true , address=81.171.14.70:4033 , piece_id=FGQSK7GKTOX7YIFQEFFRCPCMFAYXM3KYG5BKXFG24M5ZMZAM536Q, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.888628791 (21h50m29.047394535s) [noise=true , address=185.167.204.205:4012 , piece_id=ZQC3TEUY2KJSTP6PVRUH7LRXEKOPRBNRTQZJ3B5RJNCLNJKGFWLQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.888964604 (21h50m29.047730338s) [noise=true , address=185.167.204.206:4064 , piece_id=L5PQWRNKSXWJATYCBI5NUNKX3D7YGZPA5MQZIDTNBI5VXUMPCMOA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.889300015 (21h50m29.048065759s) [noise=true , address=185.167.204.206:4063 , piece_id=4YU3DU56QTK3PTGDFOZSM7AP54QGBWHWLRL73Z5TBSV5NAJJS4LA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.889668831 (21h50m29.048434565s) [noise=true , address=89.149.201.147:4006 , piece_id=E4C4RJP4BUQ2GZOLUJTEU4OQZPK7DJH53UXE5UQDBFNUT5DSU74Q, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.890043558 (21h50m29.048809292s) [noise=true , address=89.149.201.147:4003 , piece_id=3EGKGCKMS3XGQLWRV53PDVBPOGREHVFXBEIZLGIVXOUFG7XCDF4A, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.890411392 (21h50m29.049177126s) [noise=true , address=89.149.201.147:4009 , piece_id=Z2SQVAXKKDK24ABAPWSWWSY3MQDF6XS7H5NVIV2KJLHH2A6VI6MA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.890744860 (21h50m29.049510604s) [noise=true , address=185.167.204.205:4034 , piece_id=Q4AOGLWOJ2KWBPPC5QX7ZJWU6MITWIYRGY72HUXXPSC66DBSHBOA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.891059792 (21h50m29.049825536s) [noise=true , address=81.171.14.70:4036 , piece_id=GUOSAQQNW62ZRWCVGL6Q5NQP6JQV6HA4AXF3VWLYGAEL47GUHAHQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.891387249 (21h50m29.050152993s) [noise=true , address=81.171.14.70:4038 , piece_id=WOWFMBRSKEN32CF4ALEEBK4SQG5KV4DFGIPVOXAZBMPM3O7C3VIQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.891711068 (21h50m29.050476813s) [noise=true , address=89.149.201.147:4013 , piece_id=PGIOQYBNNGE7MVLACGXWBBZE3VVLGA5CYLEE3S5POWGJNGPCICWQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:02.756137007 (21h50m29.914902741s) [upload=19099]: Next returned nil segment
Aug 26 13:54:02.756157797 (21h50m29.914923562s) [upload=19099]: Waiting for error group managing segments...
Aug 26 13:54:03.141770316 (21h50m30.30053605s) [noise=true , address=81.171.14.70:4036 , piece_id=GUOSAQQNW62ZRWCVGL6Q5NQP6JQV6HA4AXF3VWLYGAEL47GUHAHQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.160459846 (21h50m30.31922558s) [noise=true , address=89.149.201.147:4010 , piece_id=XMAMRR6UZZMJEUJLGRFVSY556EM4UYSN7ZCBJ44AURYOORMM2OKA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.163994819 (21h50m30.322760553s) [noise=true , address=81.171.14.70:4033 , piece_id=FGQSK7GKTOX7YIFQEFFRCPCMFAYXM3KYG5BKXFG24M5ZMZAM536Q, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.168301840 (21h50m30.327067574s) [noise=true , address=81.171.14.70:4040 , piece_id=FXCVX7D2ZUJUOAZYE7QSNDJ5R76AJ4ELNIIAYXTJVKJQH2FAJQZQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.168551810 (21h50m30.327317544s) [noise=true , address=89.149.201.147:4001 , piece_id=34ER3B7LOYD325XXTLP35NWLWFXRCJ554L67X76QH5BQP62BYN2A, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.168724730 (21h50m30.327490464s) [noise=true , address=89.149.201.147:4007 , piece_id=ZPZHHFRSCR6PFBKKPYPFHRZDNA3NSCCXI5RPMO64C7VLYSKNO6NA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.170506129 (21h50m30.329271863s) [noise=true , address=81.171.14.70:4038 , piece_id=WOWFMBRSKEN32CF4ALEEBK4SQG5KV4DFGIPVOXAZBMPM3O7C3VIQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.191501552 (21h50m30.350267286s) [noise=true , address=89.149.201.147:4024 , piece_id=WWXOVTVDTQ66ZTNKBQGLMJURVPZG5SSIXKMAQ2SD5HWSHSE4MINA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.192082393 (21h50m30.350848127s) [noise=true , address=89.149.201.147:4003 , piece_id=3EGKGCKMS3XGQLWRV53PDVBPOGREHVFXBEIZLGIVXOUFG7XCDF4A, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.204352531 (21h50m30.363118265s) [noise=true , address=89.149.201.147:4006 , piece_id=E4C4RJP4BUQ2GZOLUJTEU4OQZPK7DJH53UXE5UQDBFNUT5DSU74Q, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.210337232 (21h50m30.369102966s) [noise=true , address=89.149.201.147:4012 , piece_id=IBSDZHBXEZLTKAGH7KX2MH44CXV55KCQHHNW67Q6BU4JFPJ3OQKQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.216140466 (21h50m30.37490619s) [noise=true , address=89.149.201.147:4009 , piece_id=Z2SQVAXKKDK24ABAPWSWWSY3MQDF6XS7H5NVIV2KJLHH2A6VI6MA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.222991034 (21h50m30.381756768s) [noise=true , address=89.149.201.147:4022 , piece_id=3KX4LDGSEDHJQWCC5ZI4722I5E2CMW4RX6H263IL7OBCZPRUHRLQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.224102041 (21h50m30.382867775s) [noise=true , address=89.149.201.147:4013 , piece_id=PGIOQYBNNGE7MVLACGXWBBZE3VVLGA5CYLEE3S5POWGJNGPCICWQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.649745264 (21h50m31.808510998s) [noise=true , address=185.167.204.205:4031 , piece_id=YMKUJCVN7X5MYTCPS4LGANGHQNRYRG4TIAYNOXZ3OVEBOMSHHNUA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.659772108 (21h50m31.818537842s) [noise=true , address=185.167.204.205:4011 , piece_id=DCNV4P3UELDL6M6FT3KQF7B3MQNJWJKHVOKLBHSYSJOVNZMZDV2Q, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.717356191 (21h50m31.876121925s) [noise=true , address=185.167.204.205:4025 , piece_id=SF5DG7GU35BSHWV4AT2HEFQ3RMTJATBO4K6AQIMNOLVZHHERY3JQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.761427507 (21h50m31.920193232s) [noise=true , address=185.167.204.206:4064 , piece_id=L5PQWRNKSXWJATYCBI5NUNKX3D7YGZPA5MQZIDTNBI5VXUMPCMOA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.134987525 (21h50m32.293753259s) [noise=true , address=185.167.204.205:4015 , piece_id=JC34DUMDYNZKGSISA6RYWXEUKGQS5GSYCUSSOMQIEH4B7A3E4GUA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.580753964 (21h50m32.739519698s) [noise=true , address=185.167.204.206:4063 , piece_id=4YU3DU56QTK3PTGDFOZSM7AP54QGBWHWLRL73Z5TBSV5NAJJS4LA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.593142106 (21h50m32.751907841s) [noise=true , address=185.167.204.205:4014 , piece_id=NV42EYTCB7OWH6LGP4ITNQOJG7M37UXQUDEQKFY6FBGBZVUSOOAA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.662163103 (21h50m32.820928837s) [noise=true , address=185.167.204.205:4032 , piece_id=KBC7HTOEV6E3SO776PJFOB7RNXZTLL5WWGVE2HYJEMZLHXWA5RKA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.726708986 (21h50m32.88547472s) [noise=true , address=185.167.204.205:4034 , piece_id=Q4AOGLWOJ2KWBPPC5QX7ZJWU6MITWIYRGY72HUXXPSC66DBSHBOA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.809011736 (21h50m32.96777746s) [noise=true , address=185.167.204.206:4037 , piece_id=LCQ62MJWQROMPP6K35VIFIQRFKWAZQVVSBCINXGNFOJD3VYZ52DA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.899597545 (21h50m33.058363269s) [noise=true , address=185.167.204.205:4012 , piece_id=ZQC3TEUY2KJSTP6PVRUH7LRXEKOPRBNRTQZJ3B5RJNCLNJKGFWLQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:06.682231402 (21h50m33.840997126s) [noise=true , address=185.167.204.206:4062 , piece_id=FZKZE6ZM5PKCIBVOBCPHT7ZZ6EMGG76KTTIQP3NTV5XEEY6DBNQQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:06.682247452 (21h50m33.841013186s) [seg_pos={0 0}, upload=19099]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:54:06.682528781 (21h50m33.841294515s) [noise=true , address=185.167.204.206:4038 , piece_id=AWZ2IGUVT243UHCEFMV7WZB4QMS4SK3U6IUR77TS6VAVSQJD7GTA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT): protocol: write tcp 188.166.225.170:38016->185.167.204.206:4038: use of closed network connection; write tcp 188.166.225.170:38016->185.167.204.206:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38016->185.167.204.206:4038: use of closed network connection
Aug 26 13:54:06.682678998 (21h50m33.841444732s) [noise=true , address=185.167.204.205:4006 , piece_id=URUYHLXT4HMCLIQLDAV2GFQ62F3672D4KX5BIX6SEEJOEERJRUJA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8): protocol: read tcp 188.166.225.170:42076->185.167.204.205:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Aug 26 13:54:06.682713213 (21h50m33.841478937s) [seg_pos={0 0}, upload=19099]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:54:06.682810059 (21h50m33.841575793s) [upload=19099]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:54:06.682814558 (21h50m33.841580292s) [upload=19099]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:54:06.919296888 (21h50m34.078062622s) [upload=19099]: Done uploading segments...
Aug 26 13:54:06.919317176 (21h50m34.0780829s) [upload=19099]: Upload finished. err: <nil>
Duration: 42.886215198s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
7.341169232s
FAIL (2025-08-26 13:56:52 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 7.341196675s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.022780993s
FAIL (2025-08-26 13:56:26 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 6.022807745s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
19 out of 60 is failed (threshold=3) [.......................XXX...XX..XXXXXX......X.XX..XXX..X.X.] duration:
22.588251654s
FAIL (2025-08-26 13:55:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
upload=19099]: Uploading piece...
Aug 26 13:54:01.888296215 (21h50m29.047061959s) [noise=true , address=81.171.14.70:4033 , piece_id=FGQSK7GKTOX7YIFQEFFRCPCMFAYXM3KYG5BKXFG24M5ZMZAM536Q, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.888628791 (21h50m29.047394535s) [noise=true , address=185.167.204.205:4012 , piece_id=ZQC3TEUY2KJSTP6PVRUH7LRXEKOPRBNRTQZJ3B5RJNCLNJKGFWLQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.888964604 (21h50m29.047730338s) [noise=true , address=185.167.204.206:4064 , piece_id=L5PQWRNKSXWJATYCBI5NUNKX3D7YGZPA5MQZIDTNBI5VXUMPCMOA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.889300015 (21h50m29.048065759s) [noise=true , address=185.167.204.206:4063 , piece_id=4YU3DU56QTK3PTGDFOZSM7AP54QGBWHWLRL73Z5TBSV5NAJJS4LA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.889668831 (21h50m29.048434565s) [noise=true , address=89.149.201.147:4006 , piece_id=E4C4RJP4BUQ2GZOLUJTEU4OQZPK7DJH53UXE5UQDBFNUT5DSU74Q, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.890043558 (21h50m29.048809292s) [noise=true , address=89.149.201.147:4003 , piece_id=3EGKGCKMS3XGQLWRV53PDVBPOGREHVFXBEIZLGIVXOUFG7XCDF4A, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.890411392 (21h50m29.049177126s) [noise=true , address=89.149.201.147:4009 , piece_id=Z2SQVAXKKDK24ABAPWSWWSY3MQDF6XS7H5NVIV2KJLHH2A6VI6MA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.890744860 (21h50m29.049510604s) [noise=true , address=185.167.204.205:4034 , piece_id=Q4AOGLWOJ2KWBPPC5QX7ZJWU6MITWIYRGY72HUXXPSC66DBSHBOA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.891059792 (21h50m29.049825536s) [noise=true , address=81.171.14.70:4036 , piece_id=GUOSAQQNW62ZRWCVGL6Q5NQP6JQV6HA4AXF3VWLYGAEL47GUHAHQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.891387249 (21h50m29.050152993s) [noise=true , address=81.171.14.70:4038 , piece_id=WOWFMBRSKEN32CF4ALEEBK4SQG5KV4DFGIPVOXAZBMPM3O7C3VIQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.891711068 (21h50m29.050476813s) [noise=true , address=89.149.201.147:4013 , piece_id=PGIOQYBNNGE7MVLACGXWBBZE3VVLGA5CYLEE3S5POWGJNGPCICWQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:02.756137007 (21h50m29.914902741s) [upload=19099]: Next returned nil segment
Aug 26 13:54:02.756157797 (21h50m29.914923562s) [upload=19099]: Waiting for error group managing segments...
Aug 26 13:54:03.141770316 (21h50m30.30053605s) [noise=true , address=81.171.14.70:4036 , piece_id=GUOSAQQNW62ZRWCVGL6Q5NQP6JQV6HA4AXF3VWLYGAEL47GUHAHQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.160459846 (21h50m30.31922558s) [noise=true , address=89.149.201.147:4010 , piece_id=XMAMRR6UZZMJEUJLGRFVSY556EM4UYSN7ZCBJ44AURYOORMM2OKA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.163994819 (21h50m30.322760553s) [noise=true , address=81.171.14.70:4033 , piece_id=FGQSK7GKTOX7YIFQEFFRCPCMFAYXM3KYG5BKXFG24M5ZMZAM536Q, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.168301840 (21h50m30.327067574s) [noise=true , address=81.171.14.70:4040 , piece_id=FXCVX7D2ZUJUOAZYE7QSNDJ5R76AJ4ELNIIAYXTJVKJQH2FAJQZQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.168551810 (21h50m30.327317544s) [noise=true , address=89.149.201.147:4001 , piece_id=34ER3B7LOYD325XXTLP35NWLWFXRCJ554L67X76QH5BQP62BYN2A, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.168724730 (21h50m30.327490464s) [noise=true , address=89.149.201.147:4007 , piece_id=ZPZHHFRSCR6PFBKKPYPFHRZDNA3NSCCXI5RPMO64C7VLYSKNO6NA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.170506129 (21h50m30.329271863s) [noise=true , address=81.171.14.70:4038 , piece_id=WOWFMBRSKEN32CF4ALEEBK4SQG5KV4DFGIPVOXAZBMPM3O7C3VIQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.191501552 (21h50m30.350267286s) [noise=true , address=89.149.201.147:4024 , piece_id=WWXOVTVDTQ66ZTNKBQGLMJURVPZG5SSIXKMAQ2SD5HWSHSE4MINA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.192082393 (21h50m30.350848127s) [noise=true , address=89.149.201.147:4003 , piece_id=3EGKGCKMS3XGQLWRV53PDVBPOGREHVFXBEIZLGIVXOUFG7XCDF4A, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.204352531 (21h50m30.363118265s) [noise=true , address=89.149.201.147:4006 , piece_id=E4C4RJP4BUQ2GZOLUJTEU4OQZPK7DJH53UXE5UQDBFNUT5DSU74Q, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.210337232 (21h50m30.369102966s) [noise=true , address=89.149.201.147:4012 , piece_id=IBSDZHBXEZLTKAGH7KX2MH44CXV55KCQHHNW67Q6BU4JFPJ3OQKQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.216140466 (21h50m30.37490619s) [noise=true , address=89.149.201.147:4009 , piece_id=Z2SQVAXKKDK24ABAPWSWWSY3MQDF6XS7H5NVIV2KJLHH2A6VI6MA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.222991034 (21h50m30.381756768s) [noise=true , address=89.149.201.147:4022 , piece_id=3KX4LDGSEDHJQWCC5ZI4722I5E2CMW4RX6H263IL7OBCZPRUHRLQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.224102041 (21h50m30.382867775s) [noise=true , address=89.149.201.147:4013 , piece_id=PGIOQYBNNGE7MVLACGXWBBZE3VVLGA5CYLEE3S5POWGJNGPCICWQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.649745264 (21h50m31.808510998s) [noise=true , address=185.167.204.205:4031 , piece_id=YMKUJCVN7X5MYTCPS4LGANGHQNRYRG4TIAYNOXZ3OVEBOMSHHNUA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.659772108 (21h50m31.818537842s) [noise=true , address=185.167.204.205:4011 , piece_id=DCNV4P3UELDL6M6FT3KQF7B3MQNJWJKHVOKLBHSYSJOVNZMZDV2Q, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.717356191 (21h50m31.876121925s) [noise=true , address=185.167.204.205:4025 , piece_id=SF5DG7GU35BSHWV4AT2HEFQ3RMTJATBO4K6AQIMNOLVZHHERY3JQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.761427507 (21h50m31.920193232s) [noise=true , address=185.167.204.206:4064 , piece_id=L5PQWRNKSXWJATYCBI5NUNKX3D7YGZPA5MQZIDTNBI5VXUMPCMOA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.134987525 (21h50m32.293753259s) [noise=true , address=185.167.204.205:4015 , piece_id=JC34DUMDYNZKGSISA6RYWXEUKGQS5GSYCUSSOMQIEH4B7A3E4GUA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.580753964 (21h50m32.739519698s) [noise=true , address=185.167.204.206:4063 , piece_id=4YU3DU56QTK3PTGDFOZSM7AP54QGBWHWLRL73Z5TBSV5NAJJS4LA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.593142106 (21h50m32.751907841s) [noise=true , address=185.167.204.205:4014 , piece_id=NV42EYTCB7OWH6LGP4ITNQOJG7M37UXQUDEQKFY6FBGBZVUSOOAA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.662163103 (21h50m32.820928837s) [noise=true , address=185.167.204.205:4032 , piece_id=KBC7HTOEV6E3SO776PJFOB7RNXZTLL5WWGVE2HYJEMZLHXWA5RKA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.726708986 (21h50m32.88547472s) [noise=true , address=185.167.204.205:4034 , piece_id=Q4AOGLWOJ2KWBPPC5QX7ZJWU6MITWIYRGY72HUXXPSC66DBSHBOA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.809011736 (21h50m32.96777746s) [noise=true , address=185.167.204.206:4037 , piece_id=LCQ62MJWQROMPP6K35VIFIQRFKWAZQVVSBCINXGNFOJD3VYZ52DA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.899597545 (21h50m33.058363269s) [noise=true , address=185.167.204.205:4012 , piece_id=ZQC3TEUY2KJSTP6PVRUH7LRXEKOPRBNRTQZJ3B5RJNCLNJKGFWLQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:06.682231402 (21h50m33.840997126s) [noise=true , address=185.167.204.206:4062 , piece_id=FZKZE6ZM5PKCIBVOBCPHT7ZZ6EMGG76KTTIQP3NTV5XEEY6DBNQQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:06.682247452 (21h50m33.841013186s) [seg_pos={0 0}, upload=19099]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:54:06.682528781 (21h50m33.841294515s) [noise=true , address=185.167.204.206:4038 , piece_id=AWZ2IGUVT243UHCEFMV7WZB4QMS4SK3U6IUR77TS6VAVSQJD7GTA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT): protocol: write tcp 188.166.225.170:38016->185.167.204.206:4038: use of closed network connection; write tcp 188.166.225.170:38016->185.167.204.206:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38016->185.167.204.206:4038: use of closed network connection
Aug 26 13:54:06.682678998 (21h50m33.841444732s) [noise=true , address=185.167.204.205:4006 , piece_id=URUYHLXT4HMCLIQLDAV2GFQ62F3672D4KX5BIX6SEEJOEERJRUJA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8): protocol: read tcp 188.166.225.170:42076->185.167.204.205:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Aug 26 13:54:06.682713213 (21h50m33.841478937s) [seg_pos={0 0}, upload=19099]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:54:06.682810059 (21h50m33.841575793s) [upload=19099]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:54:06.682814558 (21h50m33.841580292s) [upload=19099]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:54:06.919296888 (21h50m34.078062622s) [upload=19099]: Done uploading segments...
Aug 26 13:54:06.919317176 (21h50m34.0780829s) [upload=19099]: Upload finished. err: <nil>
Duration: 22.588269046s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
6.081463186s
FAIL (2025-08-26 13:55:14 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 6.081487723s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
19 out of 60 is failed (threshold=3) [........................XXX...XX..XXXXXX......X.XX..XXX..X.X] duration:
1m0.004399139s
FAIL (2025-08-26 13:55:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
upload=19099]: Uploading piece...
Aug 26 13:54:01.888296215 (21h50m29.047061959s) [noise=true , address=81.171.14.70:4033 , piece_id=FGQSK7GKTOX7YIFQEFFRCPCMFAYXM3KYG5BKXFG24M5ZMZAM536Q, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.888628791 (21h50m29.047394535s) [noise=true , address=185.167.204.205:4012 , piece_id=ZQC3TEUY2KJSTP6PVRUH7LRXEKOPRBNRTQZJ3B5RJNCLNJKGFWLQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.888964604 (21h50m29.047730338s) [noise=true , address=185.167.204.206:4064 , piece_id=L5PQWRNKSXWJATYCBI5NUNKX3D7YGZPA5MQZIDTNBI5VXUMPCMOA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.889300015 (21h50m29.048065759s) [noise=true , address=185.167.204.206:4063 , piece_id=4YU3DU56QTK3PTGDFOZSM7AP54QGBWHWLRL73Z5TBSV5NAJJS4LA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.889668831 (21h50m29.048434565s) [noise=true , address=89.149.201.147:4006 , piece_id=E4C4RJP4BUQ2GZOLUJTEU4OQZPK7DJH53UXE5UQDBFNUT5DSU74Q, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.890043558 (21h50m29.048809292s) [noise=true , address=89.149.201.147:4003 , piece_id=3EGKGCKMS3XGQLWRV53PDVBPOGREHVFXBEIZLGIVXOUFG7XCDF4A, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.890411392 (21h50m29.049177126s) [noise=true , address=89.149.201.147:4009 , piece_id=Z2SQVAXKKDK24ABAPWSWWSY3MQDF6XS7H5NVIV2KJLHH2A6VI6MA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.890744860 (21h50m29.049510604s) [noise=true , address=185.167.204.205:4034 , piece_id=Q4AOGLWOJ2KWBPPC5QX7ZJWU6MITWIYRGY72HUXXPSC66DBSHBOA, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.891059792 (21h50m29.049825536s) [noise=true , address=81.171.14.70:4036 , piece_id=GUOSAQQNW62ZRWCVGL6Q5NQP6JQV6HA4AXF3VWLYGAEL47GUHAHQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.891387249 (21h50m29.050152993s) [noise=true , address=81.171.14.70:4038 , piece_id=WOWFMBRSKEN32CF4ALEEBK4SQG5KV4DFGIPVOXAZBMPM3O7C3VIQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:01.891711068 (21h50m29.050476813s) [noise=true , address=89.149.201.147:4013 , piece_id=PGIOQYBNNGE7MVLACGXWBBZE3VVLGA5CYLEE3S5POWGJNGPCICWQ, seg_pos={0 0}, upload=19099]: Uploading piece...
Aug 26 13:54:02.756137007 (21h50m29.914902741s) [upload=19099]: Next returned nil segment
Aug 26 13:54:02.756157797 (21h50m29.914923562s) [upload=19099]: Waiting for error group managing segments...
Aug 26 13:54:03.141770316 (21h50m30.30053605s) [noise=true , address=81.171.14.70:4036 , piece_id=GUOSAQQNW62ZRWCVGL6Q5NQP6JQV6HA4AXF3VWLYGAEL47GUHAHQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.160459846 (21h50m30.31922558s) [noise=true , address=89.149.201.147:4010 , piece_id=XMAMRR6UZZMJEUJLGRFVSY556EM4UYSN7ZCBJ44AURYOORMM2OKA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.163994819 (21h50m30.322760553s) [noise=true , address=81.171.14.70:4033 , piece_id=FGQSK7GKTOX7YIFQEFFRCPCMFAYXM3KYG5BKXFG24M5ZMZAM536Q, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.168301840 (21h50m30.327067574s) [noise=true , address=81.171.14.70:4040 , piece_id=FXCVX7D2ZUJUOAZYE7QSNDJ5R76AJ4ELNIIAYXTJVKJQH2FAJQZQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.168551810 (21h50m30.327317544s) [noise=true , address=89.149.201.147:4001 , piece_id=34ER3B7LOYD325XXTLP35NWLWFXRCJ554L67X76QH5BQP62BYN2A, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.168724730 (21h50m30.327490464s) [noise=true , address=89.149.201.147:4007 , piece_id=ZPZHHFRSCR6PFBKKPYPFHRZDNA3NSCCXI5RPMO64C7VLYSKNO6NA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.170506129 (21h50m30.329271863s) [noise=true , address=81.171.14.70:4038 , piece_id=WOWFMBRSKEN32CF4ALEEBK4SQG5KV4DFGIPVOXAZBMPM3O7C3VIQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.191501552 (21h50m30.350267286s) [noise=true , address=89.149.201.147:4024 , piece_id=WWXOVTVDTQ66ZTNKBQGLMJURVPZG5SSIXKMAQ2SD5HWSHSE4MINA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.192082393 (21h50m30.350848127s) [noise=true , address=89.149.201.147:4003 , piece_id=3EGKGCKMS3XGQLWRV53PDVBPOGREHVFXBEIZLGIVXOUFG7XCDF4A, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.204352531 (21h50m30.363118265s) [noise=true , address=89.149.201.147:4006 , piece_id=E4C4RJP4BUQ2GZOLUJTEU4OQZPK7DJH53UXE5UQDBFNUT5DSU74Q, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.210337232 (21h50m30.369102966s) [noise=true , address=89.149.201.147:4012 , piece_id=IBSDZHBXEZLTKAGH7KX2MH44CXV55KCQHHNW67Q6BU4JFPJ3OQKQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.216140466 (21h50m30.37490619s) [noise=true , address=89.149.201.147:4009 , piece_id=Z2SQVAXKKDK24ABAPWSWWSY3MQDF6XS7H5NVIV2KJLHH2A6VI6MA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.222991034 (21h50m30.381756768s) [noise=true , address=89.149.201.147:4022 , piece_id=3KX4LDGSEDHJQWCC5ZI4722I5E2CMW4RX6H263IL7OBCZPRUHRLQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:03.224102041 (21h50m30.382867775s) [noise=true , address=89.149.201.147:4013 , piece_id=PGIOQYBNNGE7MVLACGXWBBZE3VVLGA5CYLEE3S5POWGJNGPCICWQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.649745264 (21h50m31.808510998s) [noise=true , address=185.167.204.205:4031 , piece_id=YMKUJCVN7X5MYTCPS4LGANGHQNRYRG4TIAYNOXZ3OVEBOMSHHNUA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.659772108 (21h50m31.818537842s) [noise=true , address=185.167.204.205:4011 , piece_id=DCNV4P3UELDL6M6FT3KQF7B3MQNJWJKHVOKLBHSYSJOVNZMZDV2Q, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.717356191 (21h50m31.876121925s) [noise=true , address=185.167.204.205:4025 , piece_id=SF5DG7GU35BSHWV4AT2HEFQ3RMTJATBO4K6AQIMNOLVZHHERY3JQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:04.761427507 (21h50m31.920193232s) [noise=true , address=185.167.204.206:4064 , piece_id=L5PQWRNKSXWJATYCBI5NUNKX3D7YGZPA5MQZIDTNBI5VXUMPCMOA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.134987525 (21h50m32.293753259s) [noise=true , address=185.167.204.205:4015 , piece_id=JC34DUMDYNZKGSISA6RYWXEUKGQS5GSYCUSSOMQIEH4B7A3E4GUA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.580753964 (21h50m32.739519698s) [noise=true , address=185.167.204.206:4063 , piece_id=4YU3DU56QTK3PTGDFOZSM7AP54QGBWHWLRL73Z5TBSV5NAJJS4LA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.593142106 (21h50m32.751907841s) [noise=true , address=185.167.204.205:4014 , piece_id=NV42EYTCB7OWH6LGP4ITNQOJG7M37UXQUDEQKFY6FBGBZVUSOOAA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.662163103 (21h50m32.820928837s) [noise=true , address=185.167.204.205:4032 , piece_id=KBC7HTOEV6E3SO776PJFOB7RNXZTLL5WWGVE2HYJEMZLHXWA5RKA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.726708986 (21h50m32.88547472s) [noise=true , address=185.167.204.205:4034 , piece_id=Q4AOGLWOJ2KWBPPC5QX7ZJWU6MITWIYRGY72HUXXPSC66DBSHBOA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.809011736 (21h50m32.96777746s) [noise=true , address=185.167.204.206:4037 , piece_id=LCQ62MJWQROMPP6K35VIFIQRFKWAZQVVSBCINXGNFOJD3VYZ52DA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:05.899597545 (21h50m33.058363269s) [noise=true , address=185.167.204.205:4012 , piece_id=ZQC3TEUY2KJSTP6PVRUH7LRXEKOPRBNRTQZJ3B5RJNCLNJKGFWLQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:06.682231402 (21h50m33.840997126s) [noise=true , address=185.167.204.206:4062 , piece_id=FZKZE6ZM5PKCIBVOBCPHT7ZZ6EMGG76KTTIQP3NTV5XEEY6DBNQQ, seg_pos={0 0}, upload=19099]: Done uploading piece. err: <nil>
Aug 26 13:54:06.682247452 (21h50m33.841013186s) [seg_pos={0 0}, upload=19099]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:54:06.682528781 (21h50m33.841294515s) [noise=true , address=185.167.204.206:4038 , piece_id=AWZ2IGUVT243UHCEFMV7WZB4QMS4SK3U6IUR77TS6VAVSQJD7GTA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT): protocol: write tcp 188.166.225.170:38016->185.167.204.206:4038: use of closed network connection; write tcp 188.166.225.170:38016->185.167.204.206:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38016->185.167.204.206:4038: use of closed network connection
Aug 26 13:54:06.682678998 (21h50m33.841444732s) [noise=true , address=185.167.204.205:4006 , piece_id=URUYHLXT4HMCLIQLDAV2GFQ62F3672D4KX5BIX6SEEJOEERJRUJA, seg_pos={0 0}, upload=19099]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8): protocol: read tcp 188.166.225.170:42076->185.167.204.205:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Aug 26 13:54:06.682713213 (21h50m33.841478937s) [seg_pos={0 0}, upload=19099]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:54:06.682810059 (21h50m33.841575793s) [upload=19099]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:54:06.682814558 (21h50m33.841580292s) [upload=19099]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:54:06.919296888 (21h50m34.078062622s) [upload=19099]: Done uploading segments...
Aug 26 13:54:06.919317176 (21h50m34.0780829s) [upload=19099]: Upload finished. err: <nil>
Duration: 1m0.004424086s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.851999819s
FAIL (2025-08-26 13:54:10 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 5.85202642s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
18 out of 60 is failed (threshold=3) [.........................XXX...XX..XXXXXX......X.XX..XXX..X.] duration:
30.486452868s
FAIL (2025-08-26 13:53:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
XOYUFFRZCUOCKZVJYVB2AJNIE3E3YA, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.514199284 (21h48m37.672965028s) [noise=true , address=185.167.204.206:4047 , piece_id=D3VMMXKV2DAUE2TBFS3JAAFTD6YVE2DXDIINAGMHB3CSYCBAAYAA, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.514519336 (21h48m37.67328507s) [noise=true , address=185.167.204.205:4014 , piece_id=JYH3OO6HNNFK65FD6LZXHVKSIH2RHKTZGWIO37LAJXIOZSCAVZBQ, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.514815453 (21h48m37.673581187s) [noise=true , address=185.167.204.205:4011 , piece_id=NMQ7ONHLB4G3RXY3SFRAOJJTRFI6PLPJCK7QV5AG4RZTYJR4MPWA, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.515204377 (21h48m37.673970111s) [noise=true , address=89.149.201.147:4020 , piece_id=YXCF455336BYXEL6THGHKD3V4BCC3EEZCDKDQHBEIR6D5IDQQP7Q, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.516269224 (21h48m37.675034958s) [noise=true , address=185.167.204.205:4017 , piece_id=LPGBNGPDCK7SJV6QTESIQJT6GPPL3532JP4UOOC2V6BR22YFIINQ, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.516633361 (21h48m37.675399095s) [noise=true , address=185.167.204.206:4065 , piece_id=GKK6PK5UGAJN4ASFH2SPC7HVDBGNJT7SJUNZ5T6IIEWT57JM44MQ, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.516953203 (21h48m37.675718937s) [noise=true , address=185.167.204.205:4029 , piece_id=WUW3B66U6JAQJK3Q6J3XJQSFD6N2NLWIGSAPEYPFK5KFBOAIP43Q, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.517285198 (21h48m37.676050932s) [noise=true , address=81.171.14.70:4039 , piece_id=V4X3MOTUFG23HOMWKLBFHEQL2WEV5GBMWMU75D473CRMP354I46Q, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.517627163 (21h48m37.676392897s) [noise=true , address=185.167.204.206:4058 , piece_id=KWJ4VPGRF76MUIXRPBDCPIU3VOVBKOI7I7YU2MIIP5T7XJIIUXMQ, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.517958828 (21h48m37.676724562s) [noise=true , address=185.167.204.206:4070 , piece_id=5Q4HYWD2YPN6Y7FQXC7IOGVUXH7H4NLRBJRMHFXFYM3ZYTWCYEIA, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.522802575 (21h48m37.681568309s) [noise=true , address=185.167.204.205:4013 , piece_id=H7ZEVQUVZNLW6Q3FMPF7UE5SEC6FPL47GAZMU3ZGGQUEECQ64CPA, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.542062938 (21h48m37.700828672s) [noise=true , address=81.171.14.70:4038 , piece_id=LFXJCJAHJ4MP6NBDHVMRGBRTBEKFBHZXPQ3XQPEX5MAK7ZPKFJBQ, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:11.367809758 (21h48m38.526575492s) [upload=19072]: Next returned nil segment
Aug 26 13:52:11.367827352 (21h48m38.526593086s) [upload=19072]: Waiting for error group managing segments...
Aug 26 13:52:11.756848874 (21h48m38.915614608s) [noise=true , address=81.171.14.70:4044 , piece_id=HHEYAFJYOWYBMKPWIFJHN3E5AKVQQNQ5KAY276ER77SCUH6OKFPQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.760263827 (21h48m38.919029562s) [noise=true , address=81.171.14.70:4033 , piece_id=HVNMQHRSLMADS2673IXGFDRTTNDTWBY6BTHMZKJK5EWJRQLVB5WQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.766964088 (21h48m38.925729822s) [noise=true , address=81.171.14.70:4039 , piece_id=V4X3MOTUFG23HOMWKLBFHEQL2WEV5GBMWMU75D473CRMP354I46Q, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.789868054 (21h48m38.948633778s) [noise=true , address=81.171.14.70:4038 , piece_id=LFXJCJAHJ4MP6NBDHVMRGBRTBEKFBHZXPQ3XQPEX5MAK7ZPKFJBQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.794806132 (21h48m38.953571866s) [noise=true , address=81.171.14.70:4041 , piece_id=TQTKRHBDLEVIJLVFO6RD5X5TCHN33IDCRQMFL6RCONZ2ONMHTCQA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.800833765 (21h48m38.9595995s) [noise=true , address=81.171.14.70:4029 , piece_id=7Z6VZF6KNFIAWZM3RUJO3SETVVEBEVZOCOWIN2W5KS3F2AO3GNYA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.801077361 (21h48m38.959843095s) [noise=true , address=81.171.14.70:4031 , piece_id=4Y3P7HGMEVWRZY3S5QQEHN2JU46HUBJ4DQPARKB277BY7QEZZMPQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.858483593 (21h48m39.017249327s) [noise=true , address=89.149.201.147:4022 , piece_id=74IDIUGYOU3URT2DFMIA3NPLH7SRSZFTZ7JAZXKOEHVMGCOHZCPQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.858721559 (21h48m39.017487283s) [noise=true , address=89.149.201.147:4020 , piece_id=YXCF455336BYXEL6THGHKD3V4BCC3EEZCDKDQHBEIR6D5IDQQP7Q, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.265646145 (21h48m40.424411869s) [noise=true , address=185.167.204.206:4063 , piece_id=CSZGM2PYY3SR2NL2GQUTIU6RKGWG372PMNUNELM6XU6XKJDFZVNA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.303414722 (21h48m40.462180456s) [noise=true , address=185.167.204.205:4008 , piece_id=KRII5P4FR3BA7DI227LPXBAPIRP76XOGXFDTAHRCLEBZTYO2IXPA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.358861285 (21h48m40.517627019s) [noise=true , address=185.167.204.205:4036 , piece_id=IV633P7UCUKBNC2Z7UFTVQXOYUFFRZCUOCKZVJYVB2AJNIE3E3YA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.370982938 (21h48m40.529748672s) [noise=true , address=185.167.204.205:4013 , piece_id=H7ZEVQUVZNLW6Q3FMPF7UE5SEC6FPL47GAZMU3ZGGQUEECQ64CPA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.434604784 (21h48m40.593370518s) [noise=true , address=185.167.204.205:4029 , piece_id=WUW3B66U6JAQJK3Q6J3XJQSFD6N2NLWIGSAPEYPFK5KFBOAIP43Q, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.612347401 (21h48m40.771113135s) [noise=true , address=185.167.204.205:4014 , piece_id=JYH3OO6HNNFK65FD6LZXHVKSIH2RHKTZGWIO37LAJXIOZSCAVZBQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.030337250 (21h48m41.189102974s) [noise=true , address=185.167.204.206:4058 , piece_id=KWJ4VPGRF76MUIXRPBDCPIU3VOVBKOI7I7YU2MIIP5T7XJIIUXMQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.156234544 (21h48m41.315000278s) [noise=true , address=185.167.204.206:4047 , piece_id=D3VMMXKV2DAUE2TBFS3JAAFTD6YVE2DXDIINAGMHB3CSYCBAAYAA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.194346678 (21h48m41.353112412s) [noise=true , address=185.167.204.206:4039 , piece_id=HH5FQ2V24STAHVHFQQZ7ERKTI73JGB3UPRAHFSPYZTOO24BSUCIA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.271360488 (21h48m41.430126222s) [noise=true , address=185.167.204.205:4017 , piece_id=LPGBNGPDCK7SJV6QTESIQJT6GPPL3532JP4UOOC2V6BR22YFIINQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.277628712 (21h48m41.436394446s) [noise=true , address=185.167.204.206:4046 , piece_id=D7LB7ZHIETTT3P2ELEBWPJEJ7I2YWKMZSQSGIDJM3WUGHFJV54OA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.407450706 (21h48m41.56621644s) [noise=true , address=185.167.204.206:4064 , piece_id=QCM2FHAQBVNS4ANO5KY7DTVPPO2EQ5MG7NSDFWA4NIEDKDDQE4CA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:15.255731302 (21h48m42.414497036s) [noise=true , address=185.167.204.206:4065 , piece_id=GKK6PK5UGAJN4ASFH2SPC7HVDBGNJT7SJUNZ5T6IIEWT57JM44MQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:15.674433414 (21h48m42.833199148s) [noise=true , address=185.167.204.206:4045 , piece_id=QSDRL3UMAAQMQ5F677CEKMRXHHNOUUVCPC7DRHXAO674ZDGQUEKA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:15.810237203 (21h48m42.969002938s) [noise=true , address=185.167.204.205:4033 , piece_id=R5QSTJCISR2ZSPAF4SJ7YGMPOZP3HMBGPNYYYYLNXRJOBLYURXKA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:16.796444361 (21h48m43.955210105s) [noise=true , address=185.167.204.206:4070 , piece_id=5Q4HYWD2YPN6Y7FQXC7IOGVUXH7H4NLRBJRMHFXFYM3ZYTWCYEIA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:17.244986852 (21h48m44.403752586s) [noise=true , address=185.167.204.206:4066 , piece_id=BW5ZHB5LEEFD2JT25IQLH7XYA6Q64YL5FZHRDPCJLUO7WIX7GAOQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:17.245012761 (21h48m44.403778495s) [seg_pos={0 0}, upload=19072]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:52:17.245219197 (21h48m44.403984931s) [noise=true , address=185.167.204.205:4030 , piece_id=ZKEEWF2MBSSGJDKYHZNRFXTNM3WPYOKMYKNLML3NQV43LZ22T52A, seg_pos={0 0}, upload=19072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk): protocol: expected piece hash; context canceled; EOF
Aug 26 13:52:17.245246419 (21h48m44.404012153s) [noise=true , address=185.167.204.205:4011 , piece_id=NMQ7ONHLB4G3RXY3SFRAOJJTRFI6PLPJCK7QV5AG4RZTYJR4MPWA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: read tcp 188.166.225.170:45834->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 26 13:52:17.245266998 (21h48m44.404032733s) [seg_pos={0 0}, upload=19072]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:52:17.245328406 (21h48m44.40409413s) [upload=19072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:52:17.245332203 (21h48m44.404097937s) [upload=19072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:52:17.484409868 (21h48m44.643175602s) [upload=19072]: Done uploading segments...
Aug 26 13:52:17.484429777 (21h48m44.643195511s) [upload=19072]: Upload finished. err: <nil>
Duration: 30.486473228s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.93969811s
FAIL (2025-08-26 13:53:13 UTC)
orbiter warning: operation: sync2.Copy uplink: context deadline exceeded
Duration: 5.939728148s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
18 out of 60 is failed (threshold=3) [..........................XXX...XX..XXXXXX......X.XX..XXX..X] duration:
1m0.002597744s
FAIL (2025-08-26 13:53:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
XOYUFFRZCUOCKZVJYVB2AJNIE3E3YA, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.514199284 (21h48m37.672965028s) [noise=true , address=185.167.204.206:4047 , piece_id=D3VMMXKV2DAUE2TBFS3JAAFTD6YVE2DXDIINAGMHB3CSYCBAAYAA, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.514519336 (21h48m37.67328507s) [noise=true , address=185.167.204.205:4014 , piece_id=JYH3OO6HNNFK65FD6LZXHVKSIH2RHKTZGWIO37LAJXIOZSCAVZBQ, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.514815453 (21h48m37.673581187s) [noise=true , address=185.167.204.205:4011 , piece_id=NMQ7ONHLB4G3RXY3SFRAOJJTRFI6PLPJCK7QV5AG4RZTYJR4MPWA, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.515204377 (21h48m37.673970111s) [noise=true , address=89.149.201.147:4020 , piece_id=YXCF455336BYXEL6THGHKD3V4BCC3EEZCDKDQHBEIR6D5IDQQP7Q, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.516269224 (21h48m37.675034958s) [noise=true , address=185.167.204.205:4017 , piece_id=LPGBNGPDCK7SJV6QTESIQJT6GPPL3532JP4UOOC2V6BR22YFIINQ, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.516633361 (21h48m37.675399095s) [noise=true , address=185.167.204.206:4065 , piece_id=GKK6PK5UGAJN4ASFH2SPC7HVDBGNJT7SJUNZ5T6IIEWT57JM44MQ, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.516953203 (21h48m37.675718937s) [noise=true , address=185.167.204.205:4029 , piece_id=WUW3B66U6JAQJK3Q6J3XJQSFD6N2NLWIGSAPEYPFK5KFBOAIP43Q, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.517285198 (21h48m37.676050932s) [noise=true , address=81.171.14.70:4039 , piece_id=V4X3MOTUFG23HOMWKLBFHEQL2WEV5GBMWMU75D473CRMP354I46Q, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.517627163 (21h48m37.676392897s) [noise=true , address=185.167.204.206:4058 , piece_id=KWJ4VPGRF76MUIXRPBDCPIU3VOVBKOI7I7YU2MIIP5T7XJIIUXMQ, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.517958828 (21h48m37.676724562s) [noise=true , address=185.167.204.206:4070 , piece_id=5Q4HYWD2YPN6Y7FQXC7IOGVUXH7H4NLRBJRMHFXFYM3ZYTWCYEIA, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.522802575 (21h48m37.681568309s) [noise=true , address=185.167.204.205:4013 , piece_id=H7ZEVQUVZNLW6Q3FMPF7UE5SEC6FPL47GAZMU3ZGGQUEECQ64CPA, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:10.542062938 (21h48m37.700828672s) [noise=true , address=81.171.14.70:4038 , piece_id=LFXJCJAHJ4MP6NBDHVMRGBRTBEKFBHZXPQ3XQPEX5MAK7ZPKFJBQ, seg_pos={0 0}, upload=19072]: Uploading piece...
Aug 26 13:52:11.367809758 (21h48m38.526575492s) [upload=19072]: Next returned nil segment
Aug 26 13:52:11.367827352 (21h48m38.526593086s) [upload=19072]: Waiting for error group managing segments...
Aug 26 13:52:11.756848874 (21h48m38.915614608s) [noise=true , address=81.171.14.70:4044 , piece_id=HHEYAFJYOWYBMKPWIFJHN3E5AKVQQNQ5KAY276ER77SCUH6OKFPQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.760263827 (21h48m38.919029562s) [noise=true , address=81.171.14.70:4033 , piece_id=HVNMQHRSLMADS2673IXGFDRTTNDTWBY6BTHMZKJK5EWJRQLVB5WQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.766964088 (21h48m38.925729822s) [noise=true , address=81.171.14.70:4039 , piece_id=V4X3MOTUFG23HOMWKLBFHEQL2WEV5GBMWMU75D473CRMP354I46Q, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.789868054 (21h48m38.948633778s) [noise=true , address=81.171.14.70:4038 , piece_id=LFXJCJAHJ4MP6NBDHVMRGBRTBEKFBHZXPQ3XQPEX5MAK7ZPKFJBQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.794806132 (21h48m38.953571866s) [noise=true , address=81.171.14.70:4041 , piece_id=TQTKRHBDLEVIJLVFO6RD5X5TCHN33IDCRQMFL6RCONZ2ONMHTCQA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.800833765 (21h48m38.9595995s) [noise=true , address=81.171.14.70:4029 , piece_id=7Z6VZF6KNFIAWZM3RUJO3SETVVEBEVZOCOWIN2W5KS3F2AO3GNYA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.801077361 (21h48m38.959843095s) [noise=true , address=81.171.14.70:4031 , piece_id=4Y3P7HGMEVWRZY3S5QQEHN2JU46HUBJ4DQPARKB277BY7QEZZMPQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.858483593 (21h48m39.017249327s) [noise=true , address=89.149.201.147:4022 , piece_id=74IDIUGYOU3URT2DFMIA3NPLH7SRSZFTZ7JAZXKOEHVMGCOHZCPQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:11.858721559 (21h48m39.017487283s) [noise=true , address=89.149.201.147:4020 , piece_id=YXCF455336BYXEL6THGHKD3V4BCC3EEZCDKDQHBEIR6D5IDQQP7Q, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.265646145 (21h48m40.424411869s) [noise=true , address=185.167.204.206:4063 , piece_id=CSZGM2PYY3SR2NL2GQUTIU6RKGWG372PMNUNELM6XU6XKJDFZVNA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.303414722 (21h48m40.462180456s) [noise=true , address=185.167.204.205:4008 , piece_id=KRII5P4FR3BA7DI227LPXBAPIRP76XOGXFDTAHRCLEBZTYO2IXPA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.358861285 (21h48m40.517627019s) [noise=true , address=185.167.204.205:4036 , piece_id=IV633P7UCUKBNC2Z7UFTVQXOYUFFRZCUOCKZVJYVB2AJNIE3E3YA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.370982938 (21h48m40.529748672s) [noise=true , address=185.167.204.205:4013 , piece_id=H7ZEVQUVZNLW6Q3FMPF7UE5SEC6FPL47GAZMU3ZGGQUEECQ64CPA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.434604784 (21h48m40.593370518s) [noise=true , address=185.167.204.205:4029 , piece_id=WUW3B66U6JAQJK3Q6J3XJQSFD6N2NLWIGSAPEYPFK5KFBOAIP43Q, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:13.612347401 (21h48m40.771113135s) [noise=true , address=185.167.204.205:4014 , piece_id=JYH3OO6HNNFK65FD6LZXHVKSIH2RHKTZGWIO37LAJXIOZSCAVZBQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.030337250 (21h48m41.189102974s) [noise=true , address=185.167.204.206:4058 , piece_id=KWJ4VPGRF76MUIXRPBDCPIU3VOVBKOI7I7YU2MIIP5T7XJIIUXMQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.156234544 (21h48m41.315000278s) [noise=true , address=185.167.204.206:4047 , piece_id=D3VMMXKV2DAUE2TBFS3JAAFTD6YVE2DXDIINAGMHB3CSYCBAAYAA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.194346678 (21h48m41.353112412s) [noise=true , address=185.167.204.206:4039 , piece_id=HH5FQ2V24STAHVHFQQZ7ERKTI73JGB3UPRAHFSPYZTOO24BSUCIA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.271360488 (21h48m41.430126222s) [noise=true , address=185.167.204.205:4017 , piece_id=LPGBNGPDCK7SJV6QTESIQJT6GPPL3532JP4UOOC2V6BR22YFIINQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.277628712 (21h48m41.436394446s) [noise=true , address=185.167.204.206:4046 , piece_id=D7LB7ZHIETTT3P2ELEBWPJEJ7I2YWKMZSQSGIDJM3WUGHFJV54OA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:14.407450706 (21h48m41.56621644s) [noise=true , address=185.167.204.206:4064 , piece_id=QCM2FHAQBVNS4ANO5KY7DTVPPO2EQ5MG7NSDFWA4NIEDKDDQE4CA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:15.255731302 (21h48m42.414497036s) [noise=true , address=185.167.204.206:4065 , piece_id=GKK6PK5UGAJN4ASFH2SPC7HVDBGNJT7SJUNZ5T6IIEWT57JM44MQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:15.674433414 (21h48m42.833199148s) [noise=true , address=185.167.204.206:4045 , piece_id=QSDRL3UMAAQMQ5F677CEKMRXHHNOUUVCPC7DRHXAO674ZDGQUEKA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:15.810237203 (21h48m42.969002938s) [noise=true , address=185.167.204.205:4033 , piece_id=R5QSTJCISR2ZSPAF4SJ7YGMPOZP3HMBGPNYYYYLNXRJOBLYURXKA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:16.796444361 (21h48m43.955210105s) [noise=true , address=185.167.204.206:4070 , piece_id=5Q4HYWD2YPN6Y7FQXC7IOGVUXH7H4NLRBJRMHFXFYM3ZYTWCYEIA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:17.244986852 (21h48m44.403752586s) [noise=true , address=185.167.204.206:4066 , piece_id=BW5ZHB5LEEFD2JT25IQLH7XYA6Q64YL5FZHRDPCJLUO7WIX7GAOQ, seg_pos={0 0}, upload=19072]: Done uploading piece. err: <nil>
Aug 26 13:52:17.245012761 (21h48m44.403778495s) [seg_pos={0 0}, upload=19072]: Segment reached optimal threshold of 26 pieces.
Aug 26 13:52:17.245219197 (21h48m44.403984931s) [noise=true , address=185.167.204.205:4030 , piece_id=ZKEEWF2MBSSGJDKYHZNRFXTNM3WPYOKMYKNLML3NQV43LZ22T52A, seg_pos={0 0}, upload=19072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk): protocol: expected piece hash; context canceled; EOF
Aug 26 13:52:17.245246419 (21h48m44.404012153s) [noise=true , address=185.167.204.205:4011 , piece_id=NMQ7ONHLB4G3RXY3SFRAOJJTRFI6PLPJCK7QV5AG4RZTYJR4MPWA, seg_pos={0 0}, upload=19072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3): protocol: read tcp 188.166.225.170:45834->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 26 13:52:17.245266998 (21h48m44.404032733s) [seg_pos={0 0}, upload=19072]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Aug 26 13:52:17.245328406 (21h48m44.40409413s) [upload=19072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 26 13:52:17.245332203 (21h48m44.404097937s) [upload=19072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 26 13:52:17.484409868 (21h48m44.643175602s) [upload=19072]: Done uploading segments...
Aug 26 13:52:17.484429777 (21h48m44.643195511s) [upload=19072]: Upload finished. err: <nil>
Duration: 1m0.002652459s
core
uplink
eu-select-1
eu1-placement-15
|