Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
713.75572ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 20:03:37 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 713.784575ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
4.767215296s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 20:02:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 4.767245202s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.118273598s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 20:02:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.118305368s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
734.226159ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 20:02:26 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 734.255604ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
4.898798475s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 20:02:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 4.898922009s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
736.000257ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 20:02:02 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 736.030355ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.861840355s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 20:01:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.861865203s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
708.393537ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 20:00:57 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 708.446889ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
4.317363117s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 20:00:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 4.317390939s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.572720646s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:59:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.57275385s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
715.883379ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:59:57 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 715.899379ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
725.302356ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:59:10 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 725.334887ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
4.626138792s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:58:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 4.626167018s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.042005095s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:58:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.042036855s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
687.532765ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:57:57 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 687.558644ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
4.603179979s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:57:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 4.603209576s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.349235559s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:57:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 6.349267309s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.231208543s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:56:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.23123271s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
702.228077ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:56:42 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 702.254429ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
710.500731ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:56:02 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 710.535627ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
5.618696885s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:55:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.618813096s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
704.617697ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:55:07 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 704.645511ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
685.541262ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:54:43 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 685.567411ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
4.627141004s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:54:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 4.627168057s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
671.62372ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:54:25 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 671.655782ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
4.293634162s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:53:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 4.293729965s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
667.480281ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:53:34 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 667.510218ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
5.199604836s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:53:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.199634223s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
727.018112ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:52:56 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 727.038382ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.242985708s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:52:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.243012329s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
719.735624ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:52:07 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 719.762948ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
693.815006ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:51:24 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 693.842248ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.236198144s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:51:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.236224114s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
6.153815535s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:50:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 6.153846093s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
701.08991ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:50:26 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 701.119746ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
680.932525ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:50:08 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 680.968474ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
722.955506ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:49:44 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 722.986966ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.034547832s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:49:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.034575645s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
711.722586ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:49:03 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 711.757983ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
682.844407ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:48:34 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 682.870287ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
700.997765ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:48:19 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 701.032742ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.070256021s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:48:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.070284855s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.072565465s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:47:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.072597848s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
668.564905ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:47:07 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 668.592087ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
704.879846ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:46:43 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 704.898562ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.076946238s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:46:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.076974793s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.251324999s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:46:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.25134699s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
739.008445ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:45:46 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 739.03284ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.844703497s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:45:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.844749033s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
702.600525ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:45:27 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 702.629391ms
edge
gateway
vhost
us-select-1
|