Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.326479928s
FAIL (2025-10-18 18:34:22 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.326510686s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
6.369703332s
FAIL (2025-10-18 18:34:19 UTC)
orbiter warning: context deadline exceeded
Duration: 6.369736323s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
6.052070254s
FAIL (2025-10-18 18:33:42 UTC)
orbiter warning: context deadline exceeded
Duration: 6.052097406s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.518597271s
FAIL (2025-10-18 18:33:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.518623151s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
6.392815309s
FAIL (2025-10-18 18:32:50 UTC)
orbiter warning: context deadline exceeded
Duration: 6.39296325s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.381204396s
FAIL (2025-10-18 18:32:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.381490001s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.147147564s
FAIL (2025-10-18 18:32:10 UTC)
orbiter warning: context deadline exceeded
Duration: 6.147752545s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.302795234s
FAIL (2025-10-18 18:31:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.302820843s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
6.583312022s
FAIL (2025-10-18 18:31:26 UTC)
orbiter warning: context deadline exceeded
Duration: 6.5833744s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
6.163290275s
FAIL (2025-10-18 18:30:49 UTC)
orbiter warning: context deadline exceeded
Duration: 6.163325694s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.468786826s
FAIL (2025-10-18 18:30:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.468814127s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.038199114s
FAIL (2025-10-18 18:30:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.038232799s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.250382134s
FAIL (2025-10-18 18:29:56 UTC)
orbiter warning: context deadline exceeded
Duration: 6.250408464s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.024971578s
FAIL (2025-10-18 18:29:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.025006003s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.346524593s
FAIL (2025-10-18 18:29:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.346546425s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
6.304729726s
FAIL (2025-10-18 18:29:01 UTC)
orbiter warning: context deadline exceeded
Duration: 6.304749495s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.471093018s
FAIL (2025-10-18 18:28:44 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.471123125s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.074337939s
FAIL (2025-10-18 18:28:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.074369451s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
6.315788639s
FAIL (2025-10-18 18:28:23 UTC)
orbiter warning: context deadline exceeded
Duration: 6.315812994s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.092977582s
FAIL (2025-10-18 18:28:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.093012478s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
6.404306949s
FAIL (2025-10-18 18:27:47 UTC)
orbiter warning: context deadline exceeded
Duration: 6.404342376s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.634654196s
FAIL (2025-10-18 18:27:38 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.634678855s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.064597501s
FAIL (2025-10-18 18:27:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.064635893s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.134712515s
FAIL (2025-10-18 18:26:51 UTC)
orbiter warning: context deadline exceeded
Duration: 6.134740898s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.092480144s
FAIL (2025-10-18 18:26:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.092513067s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.452167551s
FAIL (2025-10-18 18:26:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.452212989s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.07086246s
FAIL (2025-10-18 18:26:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.07089906s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.433107897s
FAIL (2025-10-18 18:25:53 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.4331723s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
6.292523249s
FAIL (2025-10-18 18:25:41 UTC)
orbiter warning: context deadline exceeded
Duration: 6.292551542s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.055327661s
FAIL (2025-10-18 18:25:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.055384951s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.234585037s
FAIL (2025-10-18 18:24:50 UTC)
orbiter warning: context deadline exceeded
Duration: 6.234685529s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.707866373s
FAIL (2025-10-18 18:24:47 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.707967365s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.041891105s
FAIL (2025-10-18 18:24:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.041926472s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.411096886s
FAIL (2025-10-18 18:24:11 UTC)
orbiter warning: context deadline exceeded
Duration: 6.411126043s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
4.996613084s
FAIL (2025-10-18 18:24:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 4.996643231s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
6.249907172s
FAIL (2025-10-18 18:23:54 UTC)
orbiter warning: context deadline exceeded
Duration: 6.249939203s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.037630415s
FAIL (2025-10-18 18:23:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.037672315s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.33589444s
FAIL (2025-10-18 18:23:36 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.335921391s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.163165974s
FAIL (2025-10-18 18:23:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.163196592s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
6.111993251s
FAIL (2025-10-18 18:23:28 UTC)
orbiter warning: context deadline exceeded
Duration: 6.112020102s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
5.045349471s
FAIL (2025-10-18 18:23:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.045382313s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.299997335s
FAIL (2025-10-18 18:23:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.300028645s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
6.228616426s
FAIL (2025-10-18 18:22:47 UTC)
orbiter warning: context deadline exceeded
Duration: 6.228643218s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.632897075s
FAIL (2025-10-18 18:22:22 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.632922994s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
5.008759608s
FAIL (2025-10-18 18:22:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.00879156s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
6.136074819s
FAIL (2025-10-18 18:22:03 UTC)
orbiter warning: context deadline exceeded
Duration: 6.136104505s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.046806453s
FAIL (2025-10-18 18:21:49 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.046848183s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
6.085474623s
FAIL (2025-10-18 18:21:37 UTC)
orbiter warning: context deadline exceeded
Duration: 6.085524026s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.338987507s
FAIL (2025-10-18 18:21:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.339016622s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [X.............X.............................................] duration:
5.037362712s
FAIL (2025-10-18 18:21:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
s=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075732724 (604h14m54.537825197s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.075997918 (604h14m54.538090401s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076372542 (604h14m54.538465015s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076455040 (604h14m54.538547523s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.076740673 (604h14m54.538833156s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077047897 (604h14m54.539140371s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077410709 (604h14m54.539503222s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.077777076 (604h14m54.539869559s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Uploading piece...
Oct 18 17:46:09.927864429 (604h14m55.389956922s) [upload=531583]: Next returned nil segment
Oct 18 17:46:09.927895288 (604h14m55.389987771s) [upload=531583]: Waiting for error group managing segments...
Oct 18 17:46:10.324489672 (604h14m55.786582155s) [noise=true , address=81.171.14.70:4046 , piece_id=YVXO6S6HFEF6EJYTOR3NJH2MUUXTAVESOGA73CEVDQSOPHTMMNBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.353433786 (604h14m55.815526259s) [noise=true , address=81.171.14.70:4031 , piece_id=KMMCRLREIDXOESQW247QB6YFSMGA2XCH7AYMJWCMLDDVBEASFYGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.355306041 (604h14m55.817398544s) [noise=true , address=81.171.14.70:4047 , piece_id=OHD6ISLAD7FE4QN55IFGCDPHFQPW3GFRTCDY2IQRS6MUTA7WF22Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.357503144 (604h14m55.819595617s) [noise=true , address=81.171.14.70:4032 , piece_id=LYO7C7OU5YP7YT3C7AKABK53X644EXG3DCCJZMK5ZAYNXUU3M33A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.363035409 (604h14m55.825127892s) [noise=true , address=89.149.201.147:4009 , piece_id=CRS5WFADZ5CQ2Z25EZSSALQAYXPZCRQCCGH4FSCESHLGADPREEIQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.378340732 (604h14m55.840433205s) [noise=true , address=81.171.14.70:4036 , piece_id=BXG33MMIZDHL25GYSGP5WDOTLTY5KDX3XHAKI37VCUWDXJKJHSWQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.380758146 (604h14m55.842850629s) [noise=true , address=89.149.201.147:4019 , piece_id=LAZFIR7JH2RIO4R2NELVTZBCPE2XNZZXSJTWLGKO6LAHOAIL2IDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.384560816 (604h14m55.846653289s) [noise=true , address=89.149.201.147:4023 , piece_id=VX6OZLHKW6PGPRD6TNDMY2FT4EUGIHUB6YH6NWZIERQ7VECIJXKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.386777087 (604h14m55.84886956s) [noise=true , address=81.171.14.70:4048 , piece_id=GWHSMYSJQ5JL2OWD2KBRPIUZL4B2LL4KJXZZRVVTRD4XSWJI3UQA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.397323969 (604h14m55.859416482s) [noise=true , address=89.149.201.147:4008 , piece_id=7P7BIUMRDNMOXRUWNWAIHXKO4FGKHRHUBAJUL4BNIA3CZTT2PVZQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.431327316 (604h14m55.893419799s) [noise=true , address=89.149.201.147:4013 , piece_id=PQ3ESK3L3V33VX62EYF6RHTCXEBWJEGXMVF733PXASHEPEAUVALA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.811241750 (604h14m56.273334223s) [noise=true , address=81.171.14.70:4030 , piece_id=OZO4MBQSH6GFYHPGBVHSRTL4GRLSKJ4APXGDIF672KO43NAHINAQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:10.858578967 (604h14m56.32067144s) [noise=true , address=89.149.201.147:4020 , piece_id=5LOPULVMIXSHKOUGXZXTB7LTSWIW76UTE2USVO4C74ZZQEVAIUGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:19.153148474 (604h15m4.615240957s) [noise=true , address=185.167.204.206:4070 , piece_id=HF7Y7HHATR7PFFXGB7ADKHAFAWYP3DRVKN3DKDPWH7DUC62X5PKQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:20.463671474 (604h15m5.925763957s) [noise=true , address=185.167.204.206:4050 , piece_id=K5CSLVRNJESAYNYREJPBYTBQHZ2UYWARIWB35ZXYS3TAZBLQ5QDA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:23.085208940 (604h15m8.547301423s) [noise=true , address=185.167.204.205:4025 , piece_id=LKR3QTJFZGNAIOX3332TJTLRFHOEHW67GWKO4QVXWNM5ZEDKYPBQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.559546865 (604h15m18.021639338s) [noise=true , address=185.167.204.206:4060 , piece_id=76AMZQLTEJ3ALSRLBW2GVTTYI7DQ6KHYYWIYD4CV4HHIMD2YGMJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:32.783008059 (604h15m18.245100532s) [noise=true , address=185.167.204.205:4012 , piece_id=BPRP7FFC6C2UISRHPP5TDOIC6MZNCOCHXXD6NNJUTF7EPAU7M6BQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:47.625668701 (604h15m33.087761184s) [noise=true , address=185.167.204.205:4014 , piece_id=G3CRYSJDWYCMCEUGQ4I6R6PPNXIQJ6KXDVZ3DES4CKC74PXQCN5A, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:46:52.253340056 (604h15m37.715432539s) [noise=true , address=185.167.204.206:4038 , piece_id=BVWU4NBDO3XNYGN5FWRS6CRULKUEXATUQBLCJKOXBRMQEWOACZKA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:02.728079704 (604h15m48.190172187s) [noise=true , address=185.167.204.206:4065 , piece_id=54QY7PEBQWHXBGIXKPGY4W3M3BCFYM7DQQUIT7FYW43IG4NPKJJQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: <nil>
Oct 18 17:47:08.333593285 (604h15m53.795685779s) [noise=true , address=185.167.204.205:4017 , piece_id=O3DA7AXFPUVQAHVISXPCKGIYMG5KJYSQEYYQ7QRYNIJYJLPJFS4Q, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333634844 (604h15m53.795727317s) [noise=true , address=185.167.204.206:4044 , piece_id=6QDK3WZ4EJB2XBEE4IVOKVLFNFWF3K6QNTPWXPGIID7MC2W245SQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333721680 (604h15m53.795814163s) [noise=true , address=185.167.204.205:4005 , piece_id=7L7V4DGKIXMHPL4PTDWL64P7GOZ2LS3JR4NCOXBZSCUTDVXG3LNQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333915188 (604h15m53.796007681s) [noise=true , address=185.167.204.205:4019 , piece_id=66RNAQC77Z6HUSIYS4AWSE6NAKTBD4CITAYGIEXW24ZJKOKLTDGA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.333963571 (604h15m53.796056054s) [noise=true , address=185.167.204.205:4031 , piece_id=BVSVMF4BDRI76E446UUK3T4DCGEPFBZACYSJYPPXYLICOLRBC7YQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44284->185.167.204.205:4031: use of closed network connection
Oct 18 17:47:08.334038844 (604h15m53.796131327s) [noise=true , address=185.167.204.206:4072 , piece_id=IRDTMEPGGOZC2CYKIIFFBFLMJAQEV4YF2X5OV5AQ5W2QTCZHDTUA, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334096032 (604h15m53.796188526s) [noise=true , address=185.167.204.206:4048 , piece_id=K52QBY7VJNEPACNSBMOBFTD66JIUL76D5M6AVV7MI5LDH3W73STQ, seg_pos={0 0}, upload=531583]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: expected piece hash; context deadline exceeded; EOF
Oct 18 17:47:08.334161377 (604h15m53.79625386s) [seg_pos={0 0}, upload=531583]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Oct 18 17:47:08.530278804 (604h15m53.992371297s) [upload=531583]: Done uploading segments...
Oct 18 17:47:08.530326184 (604h15m53.992418667s) [upload=531583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 5.037398269s
core
uplink
eu-select-1
eu1-placement-15
|