Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
685.755453ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:30:11 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 685.786242ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.208688822s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:29:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.208717747s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
672.330109ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:29:35 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 672.430299ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.690728311s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:29:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.690756694s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
687.526594ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:29:11 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 687.562811ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.159681981s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:28:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.159716045s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
696.818117ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:28:26 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 696.845879ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
675.176185ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:27:33 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 675.209067ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.322657633s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:27:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.32268697s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
693.420537ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:27:01 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 693.445656ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
712.458917ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:26:32 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 712.493273ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.256000815s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:26:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.25602515s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
701.770656ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:25:51 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 701.793909ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.732926084s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:25:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.732956954s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
666.454526ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:25:16 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 666.485074ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
4.588806395s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:25:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 4.588836022s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.053873488s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:24:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.053901342s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
6.551251371s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:24:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 6.551284954s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
681.516898ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:24:08 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 681.547435ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
697.91911ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:23:46 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 697.952144ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.400964815s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:23:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.400990574s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
706.328285ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:23:18 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 706.35798ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
692.053833ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:22:23 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 692.083067ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.768679754s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:22:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.768705223s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
734.810429ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:21:16 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 734.831609ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
4.693956417s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:21:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 4.693984581s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.175396605s trace:
https://jaeger.dev.storj.io/trace/5ba6bbe405020027
FAIL (2025-12-11 19:20:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.906102561 (147h50m59.777185596s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.912270185 (147h50m59.78335323s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.914526161 (147h50m59.785609206s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.915441654 (147h50m59.786524699s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.919240348 (147h50m59.790323393s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.923817132 (147h50m59.794900178s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.933052208 (147h50m59.804135243s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:19:59.934739591 (147h50m59.805822626s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Uploading piece...
Dec 11 19:20:00.739100009 (147h51m0.610183044s) [upload=129259]: Next returned nil segment
Dec 11 19:20:00.739142069 (147h51m0.610225124s) [upload=129259]: Waiting for error group managing segments...
Dec 11 19:20:01.130626251 (147h51m1.001709296s) [noise=true , address=185.167.204.205:4025 , piece_id=YQYXWCEYCZ5VTU2YKJQKABTLTW5IIMUTW6BLDWEYVI3FD3JWJF4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.134046182 (147h51m1.005129228s) [noise=true , address=185.167.204.206:4058 , piece_id=Q75KPDCWZUNWB655PX4H2E73PNHTUERDULJTECRG5UHEGX73L3EA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.137788659 (147h51m1.008871694s) [noise=true , address=185.167.204.205:4028 , piece_id=PUCV5IOVUVUNX2GFAXXEKZEI5HOH64VLB4MITZQCRXQQSA2B2Z3Q, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.138653305 (147h51m1.00973635s) [noise=true , address=185.167.204.205:4016 , piece_id=MED3XLFALTQKG5OCDZKMJHASCZ4NR5QXAXKLIMTHURPEZGTN6HTQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.139016287 (147h51m1.010099332s) [noise=true , address=185.167.204.206:4060 , piece_id=XTOSQBH5TC4ZVJDUCAFDJG6T3MLM57S7KS4UUC2T4Y7EAV5IB2BQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.141838911 (147h51m1.012921956s) [noise=true , address=185.167.204.205:4001 , piece_id=JS333SILW4NKGSQ4J4X3VFVG3UZBC2DOINQXOSOXDM7P5KU6AQ5A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.142463270 (147h51m1.013546315s) [noise=true , address=185.167.204.205:4036 , piece_id=G34FSBLI6S77WEANJXSJQ3RTHF7WU6J2YSZA7QHQSRFMAYLAQROA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.144342338 (147h51m1.015425383s) [noise=true , address=185.167.204.206:4046 , piece_id=5J2L4BRYU6MNWDQEGUBOCOI4T2BZL56BRM2WOHYBIDILBNDFGXHQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.147139524 (147h51m1.018222569s) [noise=true , address=185.167.204.205:4003 , piece_id=W6ZL3EAVRHKRXOFFV2GB3VMVBTF27LQVQJT5CY54IUSWREVD5HZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.148595848 (147h51m1.019678883s) [noise=true , address=185.167.204.206:4057 , piece_id=YSNZVDU5F6PNTMEPE2DFJT3XJAIMWJKLJHN6KYYBXPIMHV5DO6IQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153438479 (147h51m1.024521534s) [noise=true , address=185.167.204.206:4044 , piece_id=J74ZD5U736A5DYRJP4YV2GI4DWWO4DA3TTAEHDCWIJNBNZKBDFKQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153559399 (147h51m1.024642434s) [noise=true , address=185.167.204.205:4013 , piece_id=7V7M6PQ6GCT35LGUX6ZO4D3FFMQJTJ2LT37ZCRMCRUDFQMVJWEEA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.153615395 (147h51m1.024698441s) [noise=true , address=185.167.204.206:4061 , piece_id=KCBQXZ7HBNN4RMUOU3VKPYR3LJMUIKGYWVZLXVSTEEBNG5YZ2K2A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154109346 (147h51m1.025192391s) [noise=true , address=185.167.204.206:4048 , piece_id=IGJPT7JGBA7HYZAX2X4WVDY77KEQLEYL5NTPI62ZWQRYKWXR545A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.154285763 (147h51m1.025368808s) [noise=true , address=185.167.204.206:4049 , piece_id=GNSRURSA2JTR33TEYP52MF4HCLGIAGWIIWWZXDW65FMHID4ICPSA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.155076538 (147h51m1.026159583s) [noise=true , address=185.167.204.205:4035 , piece_id=FXCZMWFKEFQZ77I6PLYPSNG7OGJ4HY4UZFEFHD6SVMXLQ76AVXRA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.159621983 (147h51m1.030705049s) [noise=true , address=185.167.204.206:4041 , piece_id=N4K4OUG5PK4QMEZKD4DT5QJTBYQ7E32GTIJ47FGKE54SA6SW3ILA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:01.160537658 (147h51m1.031620713s) [noise=true , address=185.167.204.205:4005 , piece_id=72L3JB4NZKJA6FQXW4GR6XP6YM4DN36SGMYUIP6WB7LT6U4L4FLA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.414245888 (147h51m2.285328933s) [noise=true , address=89.149.201.147:4023 , piece_id=RHRMMYXPO55JWJHUJQUQMQZM4YBOUJBF6VBWGU2LY5TZMPVVVK4A, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.462235368 (147h51m2.333318413s) [noise=true , address=89.149.201.147:4022 , piece_id=SVNSDFJNRPSRP4ZZG3OQVY2WHDNT7Z6VCABUIHQXTEQ3DLQ2BYCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:02.951405903 (147h51m2.822488948s) [noise=true , address=89.149.201.147:4021 , piece_id=HLB4J5OJCCLSGPGCAKIPK6NN4EQSDTG4AQKVXOBKH3YCUI4F4WCA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:57.779717135 (147h51m57.65080017s) [noise=true , address=81.171.14.70:4035 , piece_id=IB3IEMWJ6LXFRFHEJOQPU577KV52TECJOVUAO5POWFHGRJWBG3NQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: <nil>
Dec 11 19:20:59.239689100 (147h51m59.110772135s) [noise=true , address=81.171.14.70:4041 , piece_id=42WSOM7C2RJKU55UGSTZAKPHVCZOVREQIBDED3T544IN4CWKV2MQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239810010 (147h51m59.110893055s) [noise=true , address=81.171.14.70:4033 , piece_id=JTGXKY2IKJ6M6IBYKJM5G5ZBNSU4YLJOM6DITHI3NM4EMFQRZRZQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.239925290 (147h51m59.111008325s) [noise=true , address=81.171.14.70:4043 , piece_id=34MFV3VMTDJOVQ2VJEN6T6N63BXG2OE4VGLQ5YRX7UILZK7TO7BA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39272->81.171.14.70:4043: use of closed network connection
Dec 11 19:20:59.240019679 (147h51m59.111102714s) [noise=true , address=81.171.14.70:4038 , piece_id=DJHP77IWSBRCLQATOE3ZVERMJ5SFQFCXMDNEUGAPOPG63ZO3SNQA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240106325 (147h51m59.11118937s) [noise=true , address=81.171.14.70:4042 , piece_id=YGB7EXDRD5LIBIPEEQDZNXH6T23MM5OMBQB4WJO2S2V42RYZY6MA, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Dec 11 19:20:59.240178292 (147h51m59.111261337s) [noise=true , address=81.171.14.70:4030 , piece_id=S2K4FNHNOKFARG32Q2O6L5VNQ6YSSQ5AAJT6Y5W2HXBN3EPLXYBQ, seg_pos={0 0}, upload=129259]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36766->81.171.14.70:4030: use of closed network connection
Dec 11 19:20:59.240198700 (147h51m59.111281735s) [seg_pos={0 0}, upload=129259]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Dec 11 19:20:59.413002692 (147h51m59.284085727s) [upload=129259]: Done uploading segments...
Dec 11 19:20:59.413039542 (147h51m59.284122577s) [upload=129259]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 1m0.175413587s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
755.233638ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:20:37 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 755.262304ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
491.39554ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46294e0ea0d01aea
FAIL (2025-12-11 19:19:31 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:42328->45.38.24.2:443: read: connection reset by peer
Duration: 491.417894ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
3.591127541s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 19:02:07 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.591150105s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
3.567657919s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 19:01:09 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.567771777s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
3.650641207s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 19:00:27 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.650798487s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
3.618002435s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:59:28 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.618023495s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
3.523969417s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:58:23 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.524000397s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
3.475548588s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:57:31 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.475570309s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
3.482025177s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:56:24 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.482050055s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
3.453285746s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:55:38 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.453327746s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
3.557947651s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:54:52 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.557974511s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
3.514110404s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:54:23 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.514137856s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
3.506104569s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:53:30 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.506127091s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
3.479119792s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:52:17 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.479149949s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
3.476428235s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:51:08 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.476457109s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
3.500097456s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:50:07 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.500129286s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
3.597719826s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:49:45 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.597745916s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
3.609085658s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:49:01 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.609116096s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
3.473813465s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:48:44 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.473832372s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
3.513398937s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:47:47 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.513560544s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
3.566791886s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:47:22 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.566819979s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
3.595867851s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:46:46 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.59589924s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [X...................X.......................................] duration:
3.635001807s trace:
https://jaeger.dev.storj.io/trace/1f7057b54555b314
FAIL (2025-12-11 18:45:44 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.635190717s
core
uplink
us-select-1
us1-placement-20
|