Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 478610 reports (Page 5840 of 9573)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
12 out of 60 is failed (threshold=3) [..............................XX...XX....XXXX..XX..XX.......]
duration:
2.013883796s
FAIL (2025-09-06 09:51:27 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:46:39.955557621 (187h38m36.63575321s) [upload=165105]: Starting upload
Sep  6 09:46:39.955655348 (187h38m36.635850917s) [upload=165105]: Done starting upload
Sep  6 09:46:39.955726043 (187h38m36.635921612s) [upload=165105]: Uploading segments...
Sep  6 09:46:39.955775858 (187h38m36.635971457s) [upload=165105]: Got next segment. Inline: true
Sep  6 09:46:39.955781890 (187h38m36.635977489s) [upload=165105]: Waiting for error group managing segments...
Sep  6 09:46:39.955831334 (187h38m36.636026914s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:46:39.955837576 (187h38m36.636033165s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:46:39.955842506 (187h38m36.636038106s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:47:07.270828711 (187h39m3.95102428s) [upload=165105]: Done uploading segments...
Sep  6 09:47:07.270847417 (187h39m3.951042986s) [upload=165105]: Upload finished. err: <nil>
Duration: 2.013911959s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
21 out of 60 is failed (threshold=3) [.......................XXXXXXXXXXXX...XXXXXX...X.X...X......]
duration:
2.60866864s
FAIL (2025-09-06 09:51:26 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.608692006s edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
483.449741ms
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-06 09:51:25 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 483.472925ms edge linksharing us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
8 out of 60 is failed (threshold=3) [........................X..X....X.X........X.X....X..X......]
duration:
5.368301589s
FAIL (2025-09-06 09:51:18 UTC)
orbiter warning: operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 45)
Duration: 5.36832807s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
4 out of 60 is failed (threshold=3) [........................X.........................X....XX...]
duration:
3.106435566s
FAIL (2025-09-06 09:51:13 UTC)
operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 44)
Duration: 3.106460173s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
19 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXX...]
duration:
7.326608253s
FAIL (2025-09-06 09:51:10 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 7.326637639s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
5 out of 60 is failed (threshold=3) [.....................................X.X..X.XX..............]
duration:
712.082849ms
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-09-06 09:51:08 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 712.112935ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
20 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXXXXX....]
duration:
6.008583049s
FAIL (2025-09-06 09:51:06 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Sep  6 09:48:28.774833238 (187h40m25.455028797s) [upload=165130]: Starting upload
Sep  6 09:48:28.774908102 (187h40m25.455103721s) [upload=165130]: Done starting upload
Sep  6 09:48:28.775048741 (187h40m25.45524431s) [upload=165130]: Uploading segments...
Sep  6 09:48:28.775173890 (187h40m25.455369459s) [upload=165130]: Got next segment. Inline: false
Sep  6 09:48:28.775210711 (187h40m25.45540629s) [upload=165130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:48:28.775248383 (187h40m25.455443942s) [upload=165130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep  6 09:49:24.147360685 (187h41m20.827556254s) [upload=165130]: Next segment err: context deadline exceeded
Sep  6 09:49:24.147529899 (187h41m20.827725468s) [upload=165130]: Done uploading segments...
Sep  6 09:49:24.147573752 (187h41m20.827769321s) [upload=165130]: Upload finished. err: context deadline exceeded
Duration: 6.008610703s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
7 out of 60 is failed (threshold=3) [..........................XXX....X.XX..X....................]
duration:
722.573683ms
target:
https://us1.storj.io/login
FAIL (2025-09-06 09:51:01 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 722.600534ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
15 out of 60 is failed (threshold=3) [........................X.X.X.X.XX.XXX.X..X...X..X.....XX...]
duration:
2.245130226s
FAIL (2025-09-06 09:50:56 UTC)
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.245229766s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
5 out of 60 is failed (threshold=3) [......................................X.X..X.XX.............]
duration:
741.796417ms
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-09-06 09:50:52 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 741.835883ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
12 out of 60 is failed (threshold=3) [...............................XX...XX....XXXX..XX..XX......]
duration:
2.200218364s
FAIL (2025-09-06 09:50:49 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:46:39.955557621 (187h38m36.63575321s) [upload=165105]: Starting upload
Sep  6 09:46:39.955655348 (187h38m36.635850917s) [upload=165105]: Done starting upload
Sep  6 09:46:39.955726043 (187h38m36.635921612s) [upload=165105]: Uploading segments...
Sep  6 09:46:39.955775858 (187h38m36.635971457s) [upload=165105]: Got next segment. Inline: true
Sep  6 09:46:39.955781890 (187h38m36.635977489s) [upload=165105]: Waiting for error group managing segments...
Sep  6 09:46:39.955831334 (187h38m36.636026914s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:46:39.955837576 (187h38m36.636033165s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:46:39.955842506 (187h38m36.636038106s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:47:07.270828711 (187h39m3.95102428s) [upload=165105]: Done uploading segments...
Sep  6 09:47:07.270847417 (187h39m3.951042986s) [upload=165105]: Upload finished. err: <nil>
Duration: 2.200255846s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
21 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXX...XXXXXX...X.X...X.....]
duration:
2.25876679s
FAIL (2025-09-06 09:50:47 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.258787178s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
24 out of 60 is failed (threshold=3) [.................................XXXXXXXXXXXXXXXXXXXXXXXX...]
duration:
5.025074667s
FAIL (2025-09-06 09:50:46 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.230644309 (187h40m27.910839878s) [noise=true , address=185.167.204.206:4048 , piece_id=W2QIC3CEQP5JNRY3OHEVBJL7JATEA5GLYTNX642XZQCB3VS3WNGQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.230937310 (187h40m27.911132879s) [noise=true , address=89.149.201.147:4001  , piece_id=QRYXIE7K3ZZNWTMI5IVZ4XGLUKRJ633K3ETKUJ2SKTWNO5RCQ3GA, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231204531 (187h40m27.911400101s) [noise=true , address=185.167.204.205:4024 , piece_id=J35DFASGZNSAAAJJVXGLUKX4FI4L6XAHP4IVAAHIDOSZLPITL6PA, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231539021 (187h40m27.91173459s) [noise=true , address=89.149.201.147:4017  , piece_id=ZSJJZSJPV77KT3JYWMUXGWBINY2HEACFO2YJGZE5C26QW6TIKFNQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231811022 (187h40m27.912006591s) [noise=true , address=81.171.14.70:4036    , piece_id=J7JSNGNIR6FFKNYEXDGT2ONQAK6R73C3ITFWI3CTXCAWN6UI7RFQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:32.090388124 (187h40m28.770583693s) [upload=165131]: Next returned nil segment
Sep  6 09:48:32.090408101 (187h40m28.77060367s) [upload=165131]: Waiting for error group managing segments...
Sep  6 09:48:32.489381342 (187h40m29.169576911s) [noise=true , address=89.149.201.147:4014  , piece_id=NUXJQUIXFVVJUGUHIXQPYDLIZINQFSTMFGKVDL4O4RRKZNWQFUNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.501612347 (187h40m29.181807916s) [noise=true , address=89.149.201.147:4020  , piece_id=YA3VINMPBGDBIABG6ZJDDZUJSAEFJED3BFB2GK727WBIASJVMLXQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.512745170 (187h40m29.192940739s) [noise=true , address=89.149.201.147:4017  , piece_id=ZSJJZSJPV77KT3JYWMUXGWBINY2HEACFO2YJGZE5C26QW6TIKFNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.534695914 (187h40m29.214891483s) [noise=true , address=89.149.201.147:4022  , piece_id=GZPPXQCD7HQ5SWLK4CAYATYOGOCUVCCLARJTX7L7ALW7CKWADV4Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.537630178 (187h40m29.217825747s) [noise=true , address=89.149.201.147:4011  , piece_id=6ADPCUF2NQG4KXGOSMSMWRIAHWQSQ32VRTNQ5K7ZH4T3H6JQE2XQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.546466998 (187h40m29.226662567s) [noise=true , address=89.149.201.147:4001  , piece_id=QRYXIE7K3ZZNWTMI5IVZ4XGLUKRJ633K3ETKUJ2SKTWNO5RCQ3GA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:18.452818084 (187h41m15.133013643s) [noise=true , address=185.167.204.205:4013 , piece_id=RV72BSLEVE3Q5ZFE5IWLTJREWRVBQQ5SNVFAJ5EJQAXABZPVIMGQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:20.012900022 (187h41m16.693095591s) [noise=true , address=81.171.14.70:4045    , piece_id=FKHMXBLN4YMXA3E2IPIF652CDHCTFYRLDAPTYJ56QAAE2OVP45KQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:21.012709086 (187h41m17.692904655s) [noise=true , address=81.171.14.70:4047    , piece_id=77PDCGDOO5X32KEBFUYU2MFIRPA24V7XWRSSQVESKT4T3QNHBSLQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:21.626903100 (187h41m18.307098669s) [noise=true , address=185.167.204.205:4006 , piece_id=2HPGTJHD6ZVUPHMBYY2HODBU4FCP4M4NL3TN3VBW2UH37U7ZEF6A, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:22.286253554 (187h41m18.966449123s) [noise=true , address=81.171.14.70:4036    , piece_id=J7JSNGNIR6FFKNYEXDGT2ONQAK6R73C3ITFWI3CTXCAWN6UI7RFQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:22.805006087 (187h41m19.485201656s) [noise=true , address=81.171.14.70:4033    , piece_id=CLTHTQBLDHTWT4QY3SLFGVWLFWBAI64TWHXDWA46NUNTJJ5PRD2Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.656975143 (187h41m20.337170712s) [noise=true , address=81.171.14.70:4041    , piece_id=R4JPY3MKUVY3HIQ2LKIGXCLCXQBME6DTYQNAWZLGOLQHCAE4OWNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.693921241 (187h41m20.37411681s) [noise=true , address=185.167.204.206:4063 , piece_id=6RD23BZ3WLATVOGIDMQU5B2HUISMBFGHA3VSZNC7H2B6C5VTKMVA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.795040566 (187h41m20.475236135s) [noise=true , address=185.167.204.205:4009 , piece_id=HA6VCM2SK33OVWAP6YZY4FHSLEBPU6HQOEQNULY2LFIYDXMOWQUQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:24.328248240 (187h41m21.008443809s) [noise=true , address=81.171.14.70:4030    , piece_id=M6MLP7QCDQVOAN2YZX2I6GWJBTJ4BBC2OJKDFPNH5S7CPWREYA4A, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:25.293846570 (187h41m21.974042139s) [noise=true , address=185.167.204.206:4038 , piece_id=CW6QOG56PYBJECWVJZUXVWR3ANS62ESBDK3PPAHPJDBEMKDT4PEQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:25.738447271 (187h41m22.41864284s) [noise=true , address=185.167.204.205:4024 , piece_id=J35DFASGZNSAAAJJVXGLUKX4FI4L6XAHP4IVAAHIDOSZLPITL6PA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:26.308050849 (187h41m22.988246419s) [noise=true , address=185.167.204.205:4011 , piece_id=5LPZGI5FK266NV562CZDMQPYN4I24PFB65IIEYHPQIFLGQN7A7PQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:26.656713710 (187h41m23.336909279s) [noise=true , address=81.171.14.70:4026    , piece_id=3Q6LEURKQEBPYWHWA7ILZMJC3K7NPN4KK2OPPGXLSPB72PB7BHDA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:29.983835999 (187h41m26.664031568s) [noise=true , address=185.167.204.206:4048 , piece_id=W2QIC3CEQP5JNRY3OHEVBJL7JATEA5GLYTNX642XZQCB3VS3WNGQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:30.384401717 (187h41m27.064597286s) [noise=true , address=81.171.14.70:4027    , piece_id=3SW3A6B4IESWTEXZNPN6BOKD3OJ4I76K22IXXPOLTB72EWXYUWWA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384648950 (187h41m27.064844519s) [noise=true , address=185.167.204.206:4062 , piece_id=YNECDFPNDKGGXHHCU2CWUPHYRAVMU7W5SUGYC2TANJAL4OT7MVVA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384685079 (187h41m27.064880648s) [noise=true , address=185.167.204.205:4034 , piece_id=MV6C6QZNBNKW4XNQC5XUASI5WVDOSZIEDLS77NTCBTJFM7HB6UQQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384816821 (187h41m27.06501239s) [noise=true , address=185.167.204.206:4061 , piece_id=L6MCLBE2DW3INIOGRK3PWOJIEW6OAQAU72H74DFTILSAH5UBMS2Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection; write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection
Sep  6 09:49:30.384913305 (187h41m27.065108885s) [noise=true , address=185.167.204.205:4012 , piece_id=PQSOWQ5UQPOMHZJ4Q463MQ3ORQO2DABFW4AIJVLBFXC5376NY6SQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection; write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection
Sep  6 09:49:30.384955877 (187h41m27.065151446s) [noise=true , address=185.167.204.205:4018 , piece_id=ALLU4AOERBQQ3G2PD2UZHUZWNYD5SKTKXX7B27VOONYUHUXZVSJA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection; write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection
Sep  6 09:49:30.384988379 (187h41m27.065183948s) [noise=true , address=81.171.14.70:4031    , piece_id=JX373CUHJEWZFSHIODWS23ZP7IE7YOYQ4KC4YGRVNGSE2JX3W5BA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection
Sep  6 09:49:30.385004431 (187h41m27.0652s) [seg_pos={0 0}, upload=165131]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Sep  6 09:49:30.560140329 (187h41m27.240335909s) [upload=165131]: Done uploading segments...
Sep  6 09:49:30.560168635 (187h41m27.240364204s) [upload=165131]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.02510269s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
478.022133ms
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-06 09:50:44 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 478.041891ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
32 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...]
duration:
5.939031571s
FAIL (2025-09-06 09:50:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.939043804s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
24 out of 60 is failed (threshold=3) [...............................XXXXXXXXXXXXXXXXXXXXXXXX.....]
duration:
5.555681124s
FAIL (2025-09-06 09:50:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.555701633s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
20 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXXXXX...]
duration:
5.913266278s
FAIL (2025-09-06 09:50:38 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Sep  6 09:48:28.774833238 (187h40m25.455028797s) [upload=165130]: Starting upload
Sep  6 09:48:28.774908102 (187h40m25.455103721s) [upload=165130]: Done starting upload
Sep  6 09:48:28.775048741 (187h40m25.45524431s) [upload=165130]: Uploading segments...
Sep  6 09:48:28.775173890 (187h40m25.455369459s) [upload=165130]: Got next segment. Inline: false
Sep  6 09:48:28.775210711 (187h40m25.45540629s) [upload=165130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:48:28.775248383 (187h40m25.455443942s) [upload=165130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep  6 09:49:24.147360685 (187h41m20.827556254s) [upload=165130]: Next segment err: context deadline exceeded
Sep  6 09:49:24.147529899 (187h41m20.827725468s) [upload=165130]: Done uploading segments...
Sep  6 09:49:24.147573752 (187h41m20.827769321s) [upload=165130]: Upload finished. err: context deadline exceeded
Duration: 5.913289312s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
8 out of 60 is failed (threshold=3) [.........................X..X....X.X........X.X....X..X.....]
duration:
4.842187766s
FAIL (2025-09-06 09:50:38 UTC)
orbiter warning: operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 45)
Duration: 4.842213365s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
17 out of 60 is failed (threshold=3) [........................XXXXXX.....XXX.X.X.XXXX.......X..X..]
duration:
2.012309593s
FAIL (2025-09-06 09:50:33 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:48:21.207202480 (187h40m17.887398049s) [upload=165129]: Starting upload
Sep  6 09:48:21.207262054 (187h40m17.887457623s) [upload=165129]: Done starting upload
Sep  6 09:48:21.207314074 (187h40m17.887509643s) [upload=165129]: Uploading segments...
Sep  6 09:48:21.207347838 (187h40m17.887543407s) [upload=165129]: Got next segment. Inline: true
Sep  6 09:48:21.207351706 (187h40m17.887547275s) [upload=165129]: Waiting for error group managing segments...
Sep  6 09:48:21.207382404 (187h40m17.887577973s) [upload=165129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:48:21.207386171 (187h40m17.88758174s) [upload=165129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:48:21.207388706 (187h40m17.887584275s) [upload=165129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:48:37.834981681 (187h40m34.51517725s) [upload=165129]: Done uploading segments...
Sep  6 09:48:37.834999625 (187h40m34.515195194s) [upload=165129]: Upload finished. err: <nil>
Duration: 2.012335051s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
24 out of 60 is failed (threshold=3) [................................XXXXXXXXXXXXXXXXXXXXXXXX....]
duration:
5.619047007s
FAIL (2025-09-06 09:50:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.619062748s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
7 out of 60 is failed (threshold=3) [...................................X..X..X..X.X.....X.X.....]
duration:
770.857176ms
FAIL (2025-09-06 09:50:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 770.88547ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
31 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..]
duration:
6.898348284s
FAIL (2025-09-06 09:50:22 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
7N3JQ, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235101266 (187h40m33.915296835s) [noise=true , address=77.90.31.16:4734     , piece_id=EJCMCDAJ2MNO3TBGAESVUIRC6MFCMCE5RHOSL2VYAB2O3RNR2PVA, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235220855 (187h40m33.915416424s) [noise=true , address=45.91.116.6:4975     , piece_id=4B4E7OT5JVJBUNN4ZUZ5FKRC26BGZKBLKUTOZFDKO2IRDRCC3SDA, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235421539 (187h40m33.915617108s) [noise=true , address=45.91.116.11:4117    , piece_id=GVDJ2SDK2TSG2JE652PLZOSO2UV4K4VOWZ6UXH4BUG3LUWOMYWVQ, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235433181 (187h40m33.91562875s) [noise=true , address=77.90.31.18:4806     , piece_id=FZGQ24A3E5W2WVD7Q22OIW54U77WZF57ZOXNEOYPOAOUY4ZXLYHQ, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235644736 (187h40m33.915840305s) [noise=true , address=45.91.116.8:4048     , piece_id=AFB2GS6PNU7P6JKSETSTX46KJPERVCBE4YBNKGRFGWD6K7HKIIXQ, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235709700 (187h40m33.915905269s) [noise=true , address=45.91.116.10:4083    , piece_id=B76CYZG6IRYJVE5VW6WELIEJHBWT4GHXK3NMZET3J25KZLLAZZGQ, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:49:05.524260987 (187h41m2.204456556s) [upload=165133]: Next segment err: context deadline exceeded
Sep  6 09:49:05.525151190 (187h41m2.205346759s) [noise=true , address=77.90.31.16:4734     , piece_id=EJCMCDAJ2MNO3TBGAESVUIRC6MFCMCE5RHOSL2VYAB2O3RNR2PVA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525269517 (187h41m2.205465086s) [noise=true , address=77.90.31.18:4806     , piece_id=FZGQ24A3E5W2WVD7Q22OIW54U77WZF57ZOXNEOYPOAOUY4ZXLYHQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:33854->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:33854->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33854->77.90.31.18:4806: use of closed network connection
Sep  6 09:49:05.525307279 (187h41m2.205502848s) [noise=true , address=45.91.116.7:4011     , piece_id=JEKHNX25SUJ7XXI7WFJSABFK7C6GYSCX7O5WKID3ZVDZKBIUCM5Q, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:37906->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:37906->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37906->45.91.116.7:4011: use of closed network connection
Sep  6 09:49:05.525345782 (187h41m2.205541351s) [noise=true , address=45.91.116.14:4189    , piece_id=GKEQ2IYP2FO2MFJGTXLQRUMA4BBM3A2TZYZLDCZ6GNJCNRFIKLBA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:55912->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:55912->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55912->45.91.116.14:4189: use of closed network connection
Sep  6 09:49:05.525387101 (187h41m2.20558267s) [noise=true , address=45.91.116.6:4975     , piece_id=4B4E7OT5JVJBUNN4ZUZ5FKRC26BGZKBLKUTOZFDKO2IRDRCC3SDA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: write tcp 188.166.225.170:34404->45.91.116.6:4975: use of closed network connection; write tcp 188.166.225.170:34404->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34404->45.91.116.6:4975: use of closed network connection
Sep  6 09:49:05.525432948 (187h41m2.205628517s) [noise=true , address=45.91.116.8:4048     , piece_id=AFB2GS6PNU7P6JKSETSTX46KJPERVCBE4YBNKGRFGWD6K7HKIIXQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 188.166.225.170:58976->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525464129 (187h41m2.205659688s) [noise=true , address=45.91.116.5:4298     , piece_id=ACPADRRAY3XCMND27HLWYTHBYN6JYJHX65TGHOYX6KQLAQ4H2IEA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 188.166.225.170:37724->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525495419 (187h41m2.205690988s) [noise=true , address=45.91.116.10:4082    , piece_id=BHVWAODV7TRSZVHBHIB6WOZRUDMLH4PYSGWPFMZDO2YZTX5J4FCQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: read tcp 188.166.225.170:34896->45.91.116.10:4082: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525517281 (187h41m2.20571285s) [noise=true , address=45.91.116.5:4297     , piece_id=FM3W57L7DQXWDHRD45GB55M3EFWZC6F4F5MPOUND437L4VUHX5BA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525581042 (187h41m2.205776621s) [noise=true , address=45.91.116.14:4191    , piece_id=QSLHTOV3OHJ6ON4CPQOQFOWV3NW7MFVQ5R2G44O3VUBU3X3YEFWA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 188.166.225.170:34852->45.91.116.14:4191: use of closed network connection; write tcp 188.166.225.170:34852->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34852->45.91.116.14:4191: use of closed network connection
Sep  6 09:49:05.525641939 (187h41m2.205837508s) [noise=true , address=45.91.116.13:4155    , piece_id=XV4N554TZTQFX5NE2LX6TRIGVG7TAXCZSQ7WCOQEK2WNZNWRVKLQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:41822->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:41822->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41822->45.91.116.13:4155: use of closed network connection
Sep  6 09:49:05.525702134 (187h41m2.205897703s) [noise=true , address=45.91.116.6:4974     , piece_id=VF7QLD6YLKXRLBTNJ3C3JXTPVBM3TBGQNJNH47KJW7RWXVC5KW4A, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: read tcp 188.166.225.170:44540->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525739145 (187h41m2.205934714s) [noise=true , address=45.91.116.11:4117    , piece_id=GVDJ2SDK2TSG2JE652PLZOSO2UV4K4VOWZ6UXH4BUG3LUWOMYWVQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:54696->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525773911 (187h41m2.20596948s) [noise=true , address=45.91.116.4:4938     , piece_id=4QW76PY2ZTXFMNTG75PVJGEEQG5OUZSTHRUOY4JB5N3NRNLVSSHA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: read tcp 188.166.225.170:57880->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525780784 (187h41m2.205976353s) [noise=true , address=45.91.116.10:4083    , piece_id=B76CYZG6IRYJVE5VW6WELIEJHBWT4GHXK3NMZET3J25KZLLAZZGQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 188.166.225.170:51536->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525841049 (187h41m2.206036618s) [noise=true , address=45.91.116.6:4973     , piece_id=X7D4J4KTTIWBNVAOPMTMP3N6X6EE5VZLAGEZLWIWGLDBIUB7N3JQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:43034->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525861449 (187h41m2.206057018s) [seg_pos={0 0}, upload=165133]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.898373362s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
19 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXX..]
duration:
6.362502722s
FAIL (2025-09-06 09:50:21 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 6.362531027s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
15 out of 60 is failed (threshold=3) [.........................X.X.X.X.XX.XXX.X..X...X..X.....XX..]
duration:
2.366425969s
FAIL (2025-09-06 09:50:20 UTC)
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 2.366449706s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
21 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXX...XXXXXX...X.X...X....]
duration:
2.550585266s
FAIL (2025-09-06 09:50:20 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.55060889s edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
462.889908ms
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-09-06 09:50:13 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 462.920396ms edge linksharing us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
20 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXX..]
duration:
6.007574249s
FAIL (2025-09-06 09:50:09 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Sep  6 09:48:28.774833238 (187h40m25.455028797s) [upload=165130]: Starting upload
Sep  6 09:48:28.774908102 (187h40m25.455103721s) [upload=165130]: Done starting upload
Sep  6 09:48:28.775048741 (187h40m25.45524431s) [upload=165130]: Uploading segments...
Sep  6 09:48:28.775173890 (187h40m25.455369459s) [upload=165130]: Got next segment. Inline: false
Sep  6 09:48:28.775210711 (187h40m25.45540629s) [upload=165130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:48:28.775248383 (187h40m25.455443942s) [upload=165130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep  6 09:49:24.147360685 (187h41m20.827556254s) [upload=165130]: Next segment err: context deadline exceeded
Sep  6 09:49:24.147529899 (187h41m20.827725468s) [upload=165130]: Done uploading segments...
Sep  6 09:49:24.147573752 (187h41m20.827769321s) [upload=165130]: Upload finished. err: context deadline exceeded
Duration: 6.007606481s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
5 out of 60 is failed (threshold=3) [.......................................X.X..X.XX............]
duration:
751.95778ms
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-09-06 09:50:07 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 751.9891ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
12 out of 60 is failed (threshold=3) [................................XX...XX....XXXX..XX..XX.....]
duration:
2.316321253s
FAIL (2025-09-06 09:50:05 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:46:39.955557621 (187h38m36.63575321s) [upload=165105]: Starting upload
Sep  6 09:46:39.955655348 (187h38m36.635850917s) [upload=165105]: Done starting upload
Sep  6 09:46:39.955726043 (187h38m36.635921612s) [upload=165105]: Uploading segments...
Sep  6 09:46:39.955775858 (187h38m36.635971457s) [upload=165105]: Got next segment. Inline: true
Sep  6 09:46:39.955781890 (187h38m36.635977489s) [upload=165105]: Waiting for error group managing segments...
Sep  6 09:46:39.955831334 (187h38m36.636026914s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:46:39.955837576 (187h38m36.636033165s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:46:39.955842506 (187h38m36.636038106s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:47:07.270828711 (187h39m3.95102428s) [upload=165105]: Done uploading segments...
Sep  6 09:47:07.270847417 (187h39m3.951042986s) [upload=165105]: Upload finished. err: <nil>
Duration: 2.316352842s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.........................X.........................X....XX..]
duration:
3.270676889s
FAIL (2025-09-06 09:50:05 UTC)
operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 44)
Duration: 3.270710994s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
24 out of 60 is failed (threshold=3) [..................................XXXXXXXXXXXXXXXXXXXXXXXX..]
duration:
5.001636588s
FAIL (2025-09-06 09:49:56 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.230644309 (187h40m27.910839878s) [noise=true , address=185.167.204.206:4048 , piece_id=W2QIC3CEQP5JNRY3OHEVBJL7JATEA5GLYTNX642XZQCB3VS3WNGQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.230937310 (187h40m27.911132879s) [noise=true , address=89.149.201.147:4001  , piece_id=QRYXIE7K3ZZNWTMI5IVZ4XGLUKRJ633K3ETKUJ2SKTWNO5RCQ3GA, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231204531 (187h40m27.911400101s) [noise=true , address=185.167.204.205:4024 , piece_id=J35DFASGZNSAAAJJVXGLUKX4FI4L6XAHP4IVAAHIDOSZLPITL6PA, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231539021 (187h40m27.91173459s) [noise=true , address=89.149.201.147:4017  , piece_id=ZSJJZSJPV77KT3JYWMUXGWBINY2HEACFO2YJGZE5C26QW6TIKFNQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231811022 (187h40m27.912006591s) [noise=true , address=81.171.14.70:4036    , piece_id=J7JSNGNIR6FFKNYEXDGT2ONQAK6R73C3ITFWI3CTXCAWN6UI7RFQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:32.090388124 (187h40m28.770583693s) [upload=165131]: Next returned nil segment
Sep  6 09:48:32.090408101 (187h40m28.77060367s) [upload=165131]: Waiting for error group managing segments...
Sep  6 09:48:32.489381342 (187h40m29.169576911s) [noise=true , address=89.149.201.147:4014  , piece_id=NUXJQUIXFVVJUGUHIXQPYDLIZINQFSTMFGKVDL4O4RRKZNWQFUNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.501612347 (187h40m29.181807916s) [noise=true , address=89.149.201.147:4020  , piece_id=YA3VINMPBGDBIABG6ZJDDZUJSAEFJED3BFB2GK727WBIASJVMLXQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.512745170 (187h40m29.192940739s) [noise=true , address=89.149.201.147:4017  , piece_id=ZSJJZSJPV77KT3JYWMUXGWBINY2HEACFO2YJGZE5C26QW6TIKFNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.534695914 (187h40m29.214891483s) [noise=true , address=89.149.201.147:4022  , piece_id=GZPPXQCD7HQ5SWLK4CAYATYOGOCUVCCLARJTX7L7ALW7CKWADV4Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.537630178 (187h40m29.217825747s) [noise=true , address=89.149.201.147:4011  , piece_id=6ADPCUF2NQG4KXGOSMSMWRIAHWQSQ32VRTNQ5K7ZH4T3H6JQE2XQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.546466998 (187h40m29.226662567s) [noise=true , address=89.149.201.147:4001  , piece_id=QRYXIE7K3ZZNWTMI5IVZ4XGLUKRJ633K3ETKUJ2SKTWNO5RCQ3GA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:18.452818084 (187h41m15.133013643s) [noise=true , address=185.167.204.205:4013 , piece_id=RV72BSLEVE3Q5ZFE5IWLTJREWRVBQQ5SNVFAJ5EJQAXABZPVIMGQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:20.012900022 (187h41m16.693095591s) [noise=true , address=81.171.14.70:4045    , piece_id=FKHMXBLN4YMXA3E2IPIF652CDHCTFYRLDAPTYJ56QAAE2OVP45KQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:21.012709086 (187h41m17.692904655s) [noise=true , address=81.171.14.70:4047    , piece_id=77PDCGDOO5X32KEBFUYU2MFIRPA24V7XWRSSQVESKT4T3QNHBSLQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:21.626903100 (187h41m18.307098669s) [noise=true , address=185.167.204.205:4006 , piece_id=2HPGTJHD6ZVUPHMBYY2HODBU4FCP4M4NL3TN3VBW2UH37U7ZEF6A, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:22.286253554 (187h41m18.966449123s) [noise=true , address=81.171.14.70:4036    , piece_id=J7JSNGNIR6FFKNYEXDGT2ONQAK6R73C3ITFWI3CTXCAWN6UI7RFQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:22.805006087 (187h41m19.485201656s) [noise=true , address=81.171.14.70:4033    , piece_id=CLTHTQBLDHTWT4QY3SLFGVWLFWBAI64TWHXDWA46NUNTJJ5PRD2Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.656975143 (187h41m20.337170712s) [noise=true , address=81.171.14.70:4041    , piece_id=R4JPY3MKUVY3HIQ2LKIGXCLCXQBME6DTYQNAWZLGOLQHCAE4OWNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.693921241 (187h41m20.37411681s) [noise=true , address=185.167.204.206:4063 , piece_id=6RD23BZ3WLATVOGIDMQU5B2HUISMBFGHA3VSZNC7H2B6C5VTKMVA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.795040566 (187h41m20.475236135s) [noise=true , address=185.167.204.205:4009 , piece_id=HA6VCM2SK33OVWAP6YZY4FHSLEBPU6HQOEQNULY2LFIYDXMOWQUQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:24.328248240 (187h41m21.008443809s) [noise=true , address=81.171.14.70:4030    , piece_id=M6MLP7QCDQVOAN2YZX2I6GWJBTJ4BBC2OJKDFPNH5S7CPWREYA4A, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:25.293846570 (187h41m21.974042139s) [noise=true , address=185.167.204.206:4038 , piece_id=CW6QOG56PYBJECWVJZUXVWR3ANS62ESBDK3PPAHPJDBEMKDT4PEQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:25.738447271 (187h41m22.41864284s) [noise=true , address=185.167.204.205:4024 , piece_id=J35DFASGZNSAAAJJVXGLUKX4FI4L6XAHP4IVAAHIDOSZLPITL6PA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:26.308050849 (187h41m22.988246419s) [noise=true , address=185.167.204.205:4011 , piece_id=5LPZGI5FK266NV562CZDMQPYN4I24PFB65IIEYHPQIFLGQN7A7PQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:26.656713710 (187h41m23.336909279s) [noise=true , address=81.171.14.70:4026    , piece_id=3Q6LEURKQEBPYWHWA7ILZMJC3K7NPN4KK2OPPGXLSPB72PB7BHDA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:29.983835999 (187h41m26.664031568s) [noise=true , address=185.167.204.206:4048 , piece_id=W2QIC3CEQP5JNRY3OHEVBJL7JATEA5GLYTNX642XZQCB3VS3WNGQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:30.384401717 (187h41m27.064597286s) [noise=true , address=81.171.14.70:4027    , piece_id=3SW3A6B4IESWTEXZNPN6BOKD3OJ4I76K22IXXPOLTB72EWXYUWWA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384648950 (187h41m27.064844519s) [noise=true , address=185.167.204.206:4062 , piece_id=YNECDFPNDKGGXHHCU2CWUPHYRAVMU7W5SUGYC2TANJAL4OT7MVVA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384685079 (187h41m27.064880648s) [noise=true , address=185.167.204.205:4034 , piece_id=MV6C6QZNBNKW4XNQC5XUASI5WVDOSZIEDLS77NTCBTJFM7HB6UQQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384816821 (187h41m27.06501239s) [noise=true , address=185.167.204.206:4061 , piece_id=L6MCLBE2DW3INIOGRK3PWOJIEW6OAQAU72H74DFTILSAH5UBMS2Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection; write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection
Sep  6 09:49:30.384913305 (187h41m27.065108885s) [noise=true , address=185.167.204.205:4012 , piece_id=PQSOWQ5UQPOMHZJ4Q463MQ3ORQO2DABFW4AIJVLBFXC5376NY6SQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection; write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection
Sep  6 09:49:30.384955877 (187h41m27.065151446s) [noise=true , address=185.167.204.205:4018 , piece_id=ALLU4AOERBQQ3G2PD2UZHUZWNYD5SKTKXX7B27VOONYUHUXZVSJA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection; write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection
Sep  6 09:49:30.384988379 (187h41m27.065183948s) [noise=true , address=81.171.14.70:4031    , piece_id=JX373CUHJEWZFSHIODWS23ZP7IE7YOYQ4KC4YGRVNGSE2JX3W5BA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection
Sep  6 09:49:30.385004431 (187h41m27.0652s) [seg_pos={0 0}, upload=165131]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Sep  6 09:49:30.560140329 (187h41m27.240335909s) [upload=165131]: Done uploading segments...
Sep  6 09:49:30.560168635 (187h41m27.240364204s) [upload=165131]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.00166371s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
24 out of 60 is failed (threshold=3) [.................................XXXXXXXXXXXXXXXXXXXXXXXX...]
duration:
5.527596943s
FAIL (2025-09-06 09:49:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.527623494s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
21 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXX...XXXXXX...X.X...X...]
duration:
2.475839967s
FAIL (2025-09-06 09:49:55 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.475860335s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
32 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..]
duration:
6.210496931s
FAIL (2025-09-06 09:49:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.210521788s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
20 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXX.]
duration:
21.60303816s
FAIL (2025-09-06 09:49:52 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Sep  6 09:48:28.774833238 (187h40m25.455028797s) [upload=165130]: Starting upload
Sep  6 09:48:28.774908102 (187h40m25.455103721s) [upload=165130]: Done starting upload
Sep  6 09:48:28.775048741 (187h40m25.45524431s) [upload=165130]: Uploading segments...
Sep  6 09:48:28.775173890 (187h40m25.455369459s) [upload=165130]: Got next segment. Inline: false
Sep  6 09:48:28.775210711 (187h40m25.45540629s) [upload=165130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:48:28.775248383 (187h40m25.455443942s) [upload=165130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep  6 09:49:24.147360685 (187h41m20.827556254s) [upload=165130]: Next segment err: context deadline exceeded
Sep  6 09:49:24.147529899 (187h41m20.827725468s) [upload=165130]: Done uploading segments...
Sep  6 09:49:24.147573752 (187h41m20.827769321s) [upload=165130]: Upload finished. err: context deadline exceeded
Duration: 21.603066546s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
8 out of 60 is failed (threshold=3) [..........................X..X....X.X........X.X....X..X....]
duration:
5.027914742s
FAIL (2025-09-06 09:49:49 UTC)
orbiter warning: operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 45)
Duration: 5.027935421s core uplink eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
7 out of 60 is failed (threshold=3) [...........................XXX....X.XX..X...................]
duration:
753.334465ms
target:
https://us1.storj.io/login
FAIL (2025-09-06 09:49:48 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout
Duration: 753.365264ms core satellite us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
4 out of 60 is failed (threshold=3) [..........................X.........................X....XX.]
duration:
3.11978458s
FAIL (2025-09-06 09:49:45 UTC)
operation: Commit
uplink: failed to upload enough pieces (needed at least 49 but got 44)
Duration: 3.119808066s core uplink ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
24 out of 60 is failed (threshold=3) [..................................XXXXXXXXXXXXXXXXXXXXXXXX..]
duration:
5.614126343s
FAIL (2025-09-06 09:49:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.614144357s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
24 out of 60 is failed (threshold=3) [...................................XXXXXXXXXXXXXXXXXXXXXXXX.]
duration:
4.945372103s
FAIL (2025-09-06 09:49:35 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.230644309 (187h40m27.910839878s) [noise=true , address=185.167.204.206:4048 , piece_id=W2QIC3CEQP5JNRY3OHEVBJL7JATEA5GLYTNX642XZQCB3VS3WNGQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.230937310 (187h40m27.911132879s) [noise=true , address=89.149.201.147:4001  , piece_id=QRYXIE7K3ZZNWTMI5IVZ4XGLUKRJ633K3ETKUJ2SKTWNO5RCQ3GA, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231204531 (187h40m27.911400101s) [noise=true , address=185.167.204.205:4024 , piece_id=J35DFASGZNSAAAJJVXGLUKX4FI4L6XAHP4IVAAHIDOSZLPITL6PA, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231539021 (187h40m27.91173459s) [noise=true , address=89.149.201.147:4017  , piece_id=ZSJJZSJPV77KT3JYWMUXGWBINY2HEACFO2YJGZE5C26QW6TIKFNQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231811022 (187h40m27.912006591s) [noise=true , address=81.171.14.70:4036    , piece_id=J7JSNGNIR6FFKNYEXDGT2ONQAK6R73C3ITFWI3CTXCAWN6UI7RFQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:32.090388124 (187h40m28.770583693s) [upload=165131]: Next returned nil segment
Sep  6 09:48:32.090408101 (187h40m28.77060367s) [upload=165131]: Waiting for error group managing segments...
Sep  6 09:48:32.489381342 (187h40m29.169576911s) [noise=true , address=89.149.201.147:4014  , piece_id=NUXJQUIXFVVJUGUHIXQPYDLIZINQFSTMFGKVDL4O4RRKZNWQFUNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.501612347 (187h40m29.181807916s) [noise=true , address=89.149.201.147:4020  , piece_id=YA3VINMPBGDBIABG6ZJDDZUJSAEFJED3BFB2GK727WBIASJVMLXQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.512745170 (187h40m29.192940739s) [noise=true , address=89.149.201.147:4017  , piece_id=ZSJJZSJPV77KT3JYWMUXGWBINY2HEACFO2YJGZE5C26QW6TIKFNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.534695914 (187h40m29.214891483s) [noise=true , address=89.149.201.147:4022  , piece_id=GZPPXQCD7HQ5SWLK4CAYATYOGOCUVCCLARJTX7L7ALW7CKWADV4Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.537630178 (187h40m29.217825747s) [noise=true , address=89.149.201.147:4011  , piece_id=6ADPCUF2NQG4KXGOSMSMWRIAHWQSQ32VRTNQ5K7ZH4T3H6JQE2XQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.546466998 (187h40m29.226662567s) [noise=true , address=89.149.201.147:4001  , piece_id=QRYXIE7K3ZZNWTMI5IVZ4XGLUKRJ633K3ETKUJ2SKTWNO5RCQ3GA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:18.452818084 (187h41m15.133013643s) [noise=true , address=185.167.204.205:4013 , piece_id=RV72BSLEVE3Q5ZFE5IWLTJREWRVBQQ5SNVFAJ5EJQAXABZPVIMGQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:20.012900022 (187h41m16.693095591s) [noise=true , address=81.171.14.70:4045    , piece_id=FKHMXBLN4YMXA3E2IPIF652CDHCTFYRLDAPTYJ56QAAE2OVP45KQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:21.012709086 (187h41m17.692904655s) [noise=true , address=81.171.14.70:4047    , piece_id=77PDCGDOO5X32KEBFUYU2MFIRPA24V7XWRSSQVESKT4T3QNHBSLQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:21.626903100 (187h41m18.307098669s) [noise=true , address=185.167.204.205:4006 , piece_id=2HPGTJHD6ZVUPHMBYY2HODBU4FCP4M4NL3TN3VBW2UH37U7ZEF6A, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:22.286253554 (187h41m18.966449123s) [noise=true , address=81.171.14.70:4036    , piece_id=J7JSNGNIR6FFKNYEXDGT2ONQAK6R73C3ITFWI3CTXCAWN6UI7RFQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:22.805006087 (187h41m19.485201656s) [noise=true , address=81.171.14.70:4033    , piece_id=CLTHTQBLDHTWT4QY3SLFGVWLFWBAI64TWHXDWA46NUNTJJ5PRD2Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.656975143 (187h41m20.337170712s) [noise=true , address=81.171.14.70:4041    , piece_id=R4JPY3MKUVY3HIQ2LKIGXCLCXQBME6DTYQNAWZLGOLQHCAE4OWNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.693921241 (187h41m20.37411681s) [noise=true , address=185.167.204.206:4063 , piece_id=6RD23BZ3WLATVOGIDMQU5B2HUISMBFGHA3VSZNC7H2B6C5VTKMVA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.795040566 (187h41m20.475236135s) [noise=true , address=185.167.204.205:4009 , piece_id=HA6VCM2SK33OVWAP6YZY4FHSLEBPU6HQOEQNULY2LFIYDXMOWQUQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:24.328248240 (187h41m21.008443809s) [noise=true , address=81.171.14.70:4030    , piece_id=M6MLP7QCDQVOAN2YZX2I6GWJBTJ4BBC2OJKDFPNH5S7CPWREYA4A, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:25.293846570 (187h41m21.974042139s) [noise=true , address=185.167.204.206:4038 , piece_id=CW6QOG56PYBJECWVJZUXVWR3ANS62ESBDK3PPAHPJDBEMKDT4PEQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:25.738447271 (187h41m22.41864284s) [noise=true , address=185.167.204.205:4024 , piece_id=J35DFASGZNSAAAJJVXGLUKX4FI4L6XAHP4IVAAHIDOSZLPITL6PA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:26.308050849 (187h41m22.988246419s) [noise=true , address=185.167.204.205:4011 , piece_id=5LPZGI5FK266NV562CZDMQPYN4I24PFB65IIEYHPQIFLGQN7A7PQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:26.656713710 (187h41m23.336909279s) [noise=true , address=81.171.14.70:4026    , piece_id=3Q6LEURKQEBPYWHWA7ILZMJC3K7NPN4KK2OPPGXLSPB72PB7BHDA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:29.983835999 (187h41m26.664031568s) [noise=true , address=185.167.204.206:4048 , piece_id=W2QIC3CEQP5JNRY3OHEVBJL7JATEA5GLYTNX642XZQCB3VS3WNGQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:30.384401717 (187h41m27.064597286s) [noise=true , address=81.171.14.70:4027    , piece_id=3SW3A6B4IESWTEXZNPN6BOKD3OJ4I76K22IXXPOLTB72EWXYUWWA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384648950 (187h41m27.064844519s) [noise=true , address=185.167.204.206:4062 , piece_id=YNECDFPNDKGGXHHCU2CWUPHYRAVMU7W5SUGYC2TANJAL4OT7MVVA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384685079 (187h41m27.064880648s) [noise=true , address=185.167.204.205:4034 , piece_id=MV6C6QZNBNKW4XNQC5XUASI5WVDOSZIEDLS77NTCBTJFM7HB6UQQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384816821 (187h41m27.06501239s) [noise=true , address=185.167.204.206:4061 , piece_id=L6MCLBE2DW3INIOGRK3PWOJIEW6OAQAU72H74DFTILSAH5UBMS2Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection; write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection
Sep  6 09:49:30.384913305 (187h41m27.065108885s) [noise=true , address=185.167.204.205:4012 , piece_id=PQSOWQ5UQPOMHZJ4Q463MQ3ORQO2DABFW4AIJVLBFXC5376NY6SQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection; write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection
Sep  6 09:49:30.384955877 (187h41m27.065151446s) [noise=true , address=185.167.204.205:4018 , piece_id=ALLU4AOERBQQ3G2PD2UZHUZWNYD5SKTKXX7B27VOONYUHUXZVSJA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection; write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection
Sep  6 09:49:30.384988379 (187h41m27.065183948s) [noise=true , address=81.171.14.70:4031    , piece_id=JX373CUHJEWZFSHIODWS23ZP7IE7YOYQ4KC4YGRVNGSE2JX3W5BA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection
Sep  6 09:49:30.385004431 (187h41m27.0652s) [seg_pos={0 0}, upload=165131]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Sep  6 09:49:30.560140329 (187h41m27.240335909s) [upload=165131]: Done uploading segments...
Sep  6 09:49:30.560168635 (187h41m27.240364204s) [upload=165131]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 4.945392321s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
12 out of 60 is failed (threshold=3) [.................................XX...XX....XXXX..XX..XX....]
duration:
2.087209967s
FAIL (2025-09-06 09:49:33 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:46:39.955557621 (187h38m36.63575321s) [upload=165105]: Starting upload
Sep  6 09:46:39.955655348 (187h38m36.635850917s) [upload=165105]: Done starting upload
Sep  6 09:46:39.955726043 (187h38m36.635921612s) [upload=165105]: Uploading segments...
Sep  6 09:46:39.955775858 (187h38m36.635971457s) [upload=165105]: Got next segment. Inline: true
Sep  6 09:46:39.955781890 (187h38m36.635977489s) [upload=165105]: Waiting for error group managing segments...
Sep  6 09:46:39.955831334 (187h38m36.636026914s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:46:39.955837576 (187h38m36.636033165s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:46:39.955842506 (187h38m36.636038106s) [upload=165105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:47:07.270828711 (187h39m3.95102428s) [upload=165105]: Done uploading segments...
Sep  6 09:47:07.270847417 (187h39m3.951042986s) [upload=165105]: Upload finished. err: <nil>
Duration: 2.087236289s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
17 out of 60 is failed (threshold=3) [.........................XXXXXX.....XXX.X.X.XXXX.......X..X.]
duration:
2.197638337s
FAIL (2025-09-06 09:49:30 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Sep  6 09:48:21.207202480 (187h40m17.887398049s) [upload=165129]: Starting upload
Sep  6 09:48:21.207262054 (187h40m17.887457623s) [upload=165129]: Done starting upload
Sep  6 09:48:21.207314074 (187h40m17.887509643s) [upload=165129]: Uploading segments...
Sep  6 09:48:21.207347838 (187h40m17.887543407s) [upload=165129]: Got next segment. Inline: true
Sep  6 09:48:21.207351706 (187h40m17.887547275s) [upload=165129]: Waiting for error group managing segments...
Sep  6 09:48:21.207382404 (187h40m17.887577973s) [upload=165129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:48:21.207386171 (187h40m17.88758174s) [upload=165129]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Sep  6 09:48:21.207388706 (187h40m17.887584275s) [upload=165129]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep  6 09:48:37.834981681 (187h40m34.51517725s) [upload=165129]: Done uploading segments...
Sep  6 09:48:37.834999625 (187h40m34.515195194s) [upload=165129]: Upload finished. err: <nil>
Duration: 2.197665889s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
19 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXXX.]
duration:
22.315945292s
FAIL (2025-09-06 09:49:30 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 22.315975209s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
24 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXXXXXXXXX]
duration:
1m0.177738466s
FAIL (2025-09-06 09:49:30 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.230644309 (187h40m27.910839878s) [noise=true , address=185.167.204.206:4048 , piece_id=W2QIC3CEQP5JNRY3OHEVBJL7JATEA5GLYTNX642XZQCB3VS3WNGQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.230937310 (187h40m27.911132879s) [noise=true , address=89.149.201.147:4001  , piece_id=QRYXIE7K3ZZNWTMI5IVZ4XGLUKRJ633K3ETKUJ2SKTWNO5RCQ3GA, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231204531 (187h40m27.911400101s) [noise=true , address=185.167.204.205:4024 , piece_id=J35DFASGZNSAAAJJVXGLUKX4FI4L6XAHP4IVAAHIDOSZLPITL6PA, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231539021 (187h40m27.91173459s) [noise=true , address=89.149.201.147:4017  , piece_id=ZSJJZSJPV77KT3JYWMUXGWBINY2HEACFO2YJGZE5C26QW6TIKFNQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:31.231811022 (187h40m27.912006591s) [noise=true , address=81.171.14.70:4036    , piece_id=J7JSNGNIR6FFKNYEXDGT2ONQAK6R73C3ITFWI3CTXCAWN6UI7RFQ, seg_pos={0 0}, upload=165131]: Uploading piece...
Sep  6 09:48:32.090388124 (187h40m28.770583693s) [upload=165131]: Next returned nil segment
Sep  6 09:48:32.090408101 (187h40m28.77060367s) [upload=165131]: Waiting for error group managing segments...
Sep  6 09:48:32.489381342 (187h40m29.169576911s) [noise=true , address=89.149.201.147:4014  , piece_id=NUXJQUIXFVVJUGUHIXQPYDLIZINQFSTMFGKVDL4O4RRKZNWQFUNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.501612347 (187h40m29.181807916s) [noise=true , address=89.149.201.147:4020  , piece_id=YA3VINMPBGDBIABG6ZJDDZUJSAEFJED3BFB2GK727WBIASJVMLXQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.512745170 (187h40m29.192940739s) [noise=true , address=89.149.201.147:4017  , piece_id=ZSJJZSJPV77KT3JYWMUXGWBINY2HEACFO2YJGZE5C26QW6TIKFNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.534695914 (187h40m29.214891483s) [noise=true , address=89.149.201.147:4022  , piece_id=GZPPXQCD7HQ5SWLK4CAYATYOGOCUVCCLARJTX7L7ALW7CKWADV4Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.537630178 (187h40m29.217825747s) [noise=true , address=89.149.201.147:4011  , piece_id=6ADPCUF2NQG4KXGOSMSMWRIAHWQSQ32VRTNQ5K7ZH4T3H6JQE2XQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:48:32.546466998 (187h40m29.226662567s) [noise=true , address=89.149.201.147:4001  , piece_id=QRYXIE7K3ZZNWTMI5IVZ4XGLUKRJ633K3ETKUJ2SKTWNO5RCQ3GA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:18.452818084 (187h41m15.133013643s) [noise=true , address=185.167.204.205:4013 , piece_id=RV72BSLEVE3Q5ZFE5IWLTJREWRVBQQ5SNVFAJ5EJQAXABZPVIMGQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:20.012900022 (187h41m16.693095591s) [noise=true , address=81.171.14.70:4045    , piece_id=FKHMXBLN4YMXA3E2IPIF652CDHCTFYRLDAPTYJ56QAAE2OVP45KQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:21.012709086 (187h41m17.692904655s) [noise=true , address=81.171.14.70:4047    , piece_id=77PDCGDOO5X32KEBFUYU2MFIRPA24V7XWRSSQVESKT4T3QNHBSLQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:21.626903100 (187h41m18.307098669s) [noise=true , address=185.167.204.205:4006 , piece_id=2HPGTJHD6ZVUPHMBYY2HODBU4FCP4M4NL3TN3VBW2UH37U7ZEF6A, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:22.286253554 (187h41m18.966449123s) [noise=true , address=81.171.14.70:4036    , piece_id=J7JSNGNIR6FFKNYEXDGT2ONQAK6R73C3ITFWI3CTXCAWN6UI7RFQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:22.805006087 (187h41m19.485201656s) [noise=true , address=81.171.14.70:4033    , piece_id=CLTHTQBLDHTWT4QY3SLFGVWLFWBAI64TWHXDWA46NUNTJJ5PRD2Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.656975143 (187h41m20.337170712s) [noise=true , address=81.171.14.70:4041    , piece_id=R4JPY3MKUVY3HIQ2LKIGXCLCXQBME6DTYQNAWZLGOLQHCAE4OWNQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.693921241 (187h41m20.37411681s) [noise=true , address=185.167.204.206:4063 , piece_id=6RD23BZ3WLATVOGIDMQU5B2HUISMBFGHA3VSZNC7H2B6C5VTKMVA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:23.795040566 (187h41m20.475236135s) [noise=true , address=185.167.204.205:4009 , piece_id=HA6VCM2SK33OVWAP6YZY4FHSLEBPU6HQOEQNULY2LFIYDXMOWQUQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:24.328248240 (187h41m21.008443809s) [noise=true , address=81.171.14.70:4030    , piece_id=M6MLP7QCDQVOAN2YZX2I6GWJBTJ4BBC2OJKDFPNH5S7CPWREYA4A, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:25.293846570 (187h41m21.974042139s) [noise=true , address=185.167.204.206:4038 , piece_id=CW6QOG56PYBJECWVJZUXVWR3ANS62ESBDK3PPAHPJDBEMKDT4PEQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:25.738447271 (187h41m22.41864284s) [noise=true , address=185.167.204.205:4024 , piece_id=J35DFASGZNSAAAJJVXGLUKX4FI4L6XAHP4IVAAHIDOSZLPITL6PA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:26.308050849 (187h41m22.988246419s) [noise=true , address=185.167.204.205:4011 , piece_id=5LPZGI5FK266NV562CZDMQPYN4I24PFB65IIEYHPQIFLGQN7A7PQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:26.656713710 (187h41m23.336909279s) [noise=true , address=81.171.14.70:4026    , piece_id=3Q6LEURKQEBPYWHWA7ILZMJC3K7NPN4KK2OPPGXLSPB72PB7BHDA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:29.983835999 (187h41m26.664031568s) [noise=true , address=185.167.204.206:4048 , piece_id=W2QIC3CEQP5JNRY3OHEVBJL7JATEA5GLYTNX642XZQCB3VS3WNGQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: <nil>
Sep  6 09:49:30.384401717 (187h41m27.064597286s) [noise=true , address=81.171.14.70:4027    , piece_id=3SW3A6B4IESWTEXZNPN6BOKD3OJ4I76K22IXXPOLTB72EWXYUWWA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384648950 (187h41m27.064844519s) [noise=true , address=185.167.204.206:4062 , piece_id=YNECDFPNDKGGXHHCU2CWUPHYRAVMU7W5SUGYC2TANJAL4OT7MVVA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384685079 (187h41m27.064880648s) [noise=true , address=185.167.204.205:4034 , piece_id=MV6C6QZNBNKW4XNQC5XUASI5WVDOSZIEDLS77NTCBTJFM7HB6UQQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: expected piece hash; context deadline exceeded; EOF
Sep  6 09:49:30.384816821 (187h41m27.06501239s) [noise=true , address=185.167.204.206:4061 , piece_id=L6MCLBE2DW3INIOGRK3PWOJIEW6OAQAU72H74DFTILSAH5UBMS2Q, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection; write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47066->185.167.204.206:4061: use of closed network connection
Sep  6 09:49:30.384913305 (187h41m27.065108885s) [noise=true , address=185.167.204.205:4012 , piece_id=PQSOWQ5UQPOMHZJ4Q463MQ3ORQO2DABFW4AIJVLBFXC5376NY6SQ, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection; write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56056->185.167.204.205:4012: use of closed network connection
Sep  6 09:49:30.384955877 (187h41m27.065151446s) [noise=true , address=185.167.204.205:4018 , piece_id=ALLU4AOERBQQ3G2PD2UZHUZWNYD5SKTKXX7B27VOONYUHUXZVSJA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection; write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54042->185.167.204.205:4018: use of closed network connection
Sep  6 09:49:30.384988379 (187h41m27.065183948s) [noise=true , address=81.171.14.70:4031    , piece_id=JX373CUHJEWZFSHIODWS23ZP7IE7YOYQ4KC4YGRVNGSE2JX3W5BA, seg_pos={0 0}, upload=165131]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38592->81.171.14.70:4031: use of closed network connection
Sep  6 09:49:30.385004431 (187h41m27.0652s) [seg_pos={0 0}, upload=165131]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Sep  6 09:49:30.560140329 (187h41m27.240335909s) [upload=165131]: Done uploading segments...
Sep  6 09:49:30.560168635 (187h41m27.240364204s) [upload=165131]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 1m0.177753304s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
32 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.]
duration:
6.31781158s
FAIL (2025-09-06 09:49:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.317833062s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
7 out of 60 is failed (threshold=3) [....................................X..X..X..X.X.....X.X....]
duration:
773.340808ms
FAIL (2025-09-06 09:49:26 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 773.365335ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
20 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXXXX]
duration:
1m0.001039075s
FAIL (2025-09-06 09:49:24 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Sep  6 09:48:28.774833238 (187h40m25.455028797s) [upload=165130]: Starting upload
Sep  6 09:48:28.774908102 (187h40m25.455103721s) [upload=165130]: Done starting upload
Sep  6 09:48:28.775048741 (187h40m25.45524431s) [upload=165130]: Uploading segments...
Sep  6 09:48:28.775173890 (187h40m25.455369459s) [upload=165130]: Got next segment. Inline: false
Sep  6 09:48:28.775210711 (187h40m25.45540629s) [upload=165130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep  6 09:48:28.775248383 (187h40m25.455443942s) [upload=165130]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep  6 09:49:24.147360685 (187h41m20.827556254s) [upload=165130]: Next segment err: context deadline exceeded
Sep  6 09:49:24.147529899 (187h41m20.827725468s) [upload=165130]: Done uploading segments...
Sep  6 09:49:24.147573752 (187h41m20.827769321s) [upload=165130]: Upload finished. err: context deadline exceeded
Duration: 1m0.001060746s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
31 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.]
duration:
11.192035763s
FAIL (2025-09-06 09:49:22 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
7N3JQ, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235101266 (187h40m33.915296835s) [noise=true , address=77.90.31.16:4734     , piece_id=EJCMCDAJ2MNO3TBGAESVUIRC6MFCMCE5RHOSL2VYAB2O3RNR2PVA, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235220855 (187h40m33.915416424s) [noise=true , address=45.91.116.6:4975     , piece_id=4B4E7OT5JVJBUNN4ZUZ5FKRC26BGZKBLKUTOZFDKO2IRDRCC3SDA, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235421539 (187h40m33.915617108s) [noise=true , address=45.91.116.11:4117    , piece_id=GVDJ2SDK2TSG2JE652PLZOSO2UV4K4VOWZ6UXH4BUG3LUWOMYWVQ, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235433181 (187h40m33.91562875s) [noise=true , address=77.90.31.18:4806     , piece_id=FZGQ24A3E5W2WVD7Q22OIW54U77WZF57ZOXNEOYPOAOUY4ZXLYHQ, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235644736 (187h40m33.915840305s) [noise=true , address=45.91.116.8:4048     , piece_id=AFB2GS6PNU7P6JKSETSTX46KJPERVCBE4YBNKGRFGWD6K7HKIIXQ, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:48:37.235709700 (187h40m33.915905269s) [noise=true , address=45.91.116.10:4083    , piece_id=B76CYZG6IRYJVE5VW6WELIEJHBWT4GHXK3NMZET3J25KZLLAZZGQ, seg_pos={0 0}, upload=165133]: Uploading piece...
Sep  6 09:49:05.524260987 (187h41m2.204456556s) [upload=165133]: Next segment err: context deadline exceeded
Sep  6 09:49:05.525151190 (187h41m2.205346759s) [noise=true , address=77.90.31.16:4734     , piece_id=EJCMCDAJ2MNO3TBGAESVUIRC6MFCMCE5RHOSL2VYAB2O3RNR2PVA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525269517 (187h41m2.205465086s) [noise=true , address=77.90.31.18:4806     , piece_id=FZGQ24A3E5W2WVD7Q22OIW54U77WZF57ZOXNEOYPOAOUY4ZXLYHQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:33854->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:33854->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33854->77.90.31.18:4806: use of closed network connection
Sep  6 09:49:05.525307279 (187h41m2.205502848s) [noise=true , address=45.91.116.7:4011     , piece_id=JEKHNX25SUJ7XXI7WFJSABFK7C6GYSCX7O5WKID3ZVDZKBIUCM5Q, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:37906->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:37906->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37906->45.91.116.7:4011: use of closed network connection
Sep  6 09:49:05.525345782 (187h41m2.205541351s) [noise=true , address=45.91.116.14:4189    , piece_id=GKEQ2IYP2FO2MFJGTXLQRUMA4BBM3A2TZYZLDCZ6GNJCNRFIKLBA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:55912->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:55912->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55912->45.91.116.14:4189: use of closed network connection
Sep  6 09:49:05.525387101 (187h41m2.20558267s) [noise=true , address=45.91.116.6:4975     , piece_id=4B4E7OT5JVJBUNN4ZUZ5FKRC26BGZKBLKUTOZFDKO2IRDRCC3SDA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: write tcp 188.166.225.170:34404->45.91.116.6:4975: use of closed network connection; write tcp 188.166.225.170:34404->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34404->45.91.116.6:4975: use of closed network connection
Sep  6 09:49:05.525432948 (187h41m2.205628517s) [noise=true , address=45.91.116.8:4048     , piece_id=AFB2GS6PNU7P6JKSETSTX46KJPERVCBE4YBNKGRFGWD6K7HKIIXQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 188.166.225.170:58976->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525464129 (187h41m2.205659688s) [noise=true , address=45.91.116.5:4298     , piece_id=ACPADRRAY3XCMND27HLWYTHBYN6JYJHX65TGHOYX6KQLAQ4H2IEA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 188.166.225.170:37724->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525495419 (187h41m2.205690988s) [noise=true , address=45.91.116.10:4082    , piece_id=BHVWAODV7TRSZVHBHIB6WOZRUDMLH4PYSGWPFMZDO2YZTX5J4FCQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: read tcp 188.166.225.170:34896->45.91.116.10:4082: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525517281 (187h41m2.20571285s) [noise=true , address=45.91.116.5:4297     , piece_id=FM3W57L7DQXWDHRD45GB55M3EFWZC6F4F5MPOUND437L4VUHX5BA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525581042 (187h41m2.205776621s) [noise=true , address=45.91.116.14:4191    , piece_id=QSLHTOV3OHJ6ON4CPQOQFOWV3NW7MFVQ5R2G44O3VUBU3X3YEFWA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 188.166.225.170:34852->45.91.116.14:4191: use of closed network connection; write tcp 188.166.225.170:34852->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34852->45.91.116.14:4191: use of closed network connection
Sep  6 09:49:05.525641939 (187h41m2.205837508s) [noise=true , address=45.91.116.13:4155    , piece_id=XV4N554TZTQFX5NE2LX6TRIGVG7TAXCZSQ7WCOQEK2WNZNWRVKLQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:41822->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:41822->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41822->45.91.116.13:4155: use of closed network connection
Sep  6 09:49:05.525702134 (187h41m2.205897703s) [noise=true , address=45.91.116.6:4974     , piece_id=VF7QLD6YLKXRLBTNJ3C3JXTPVBM3TBGQNJNH47KJW7RWXVC5KW4A, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: read tcp 188.166.225.170:44540->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525739145 (187h41m2.205934714s) [noise=true , address=45.91.116.11:4117    , piece_id=GVDJ2SDK2TSG2JE652PLZOSO2UV4K4VOWZ6UXH4BUG3LUWOMYWVQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:54696->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525773911 (187h41m2.20596948s) [noise=true , address=45.91.116.4:4938     , piece_id=4QW76PY2ZTXFMNTG75PVJGEEQG5OUZSTHRUOY4JB5N3NRNLVSSHA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: read tcp 188.166.225.170:57880->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525780784 (187h41m2.205976353s) [noise=true , address=45.91.116.10:4083    , piece_id=B76CYZG6IRYJVE5VW6WELIEJHBWT4GHXK3NMZET3J25KZLLAZZGQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 188.166.225.170:51536->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525841049 (187h41m2.206036618s) [noise=true , address=45.91.116.6:4973     , piece_id=X7D4J4KTTIWBNVAOPMTMP3N6X6EE5VZLAGEZLWIWGLDBIUB7N3JQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:43034->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep  6 09:49:05.525861449 (187h41m2.206057018s) [seg_pos={0 0}, upload=165133]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 11.1920651s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
15 out of 60 is failed (threshold=3) [..........................X.X.X.X.XX.XXX.X..X...X..X.....XX.]
duration:
3.617750529s
FAIL (2025-09-06 09:49:22 UTC)
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 3.617775225s core uplink us1