Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.63238884s
FAIL (2025-09-06 19:42:09 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.632413227s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.043775432s
FAIL (2025-09-06 19:41:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 5.04380479s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
6.285250356s
FAIL (2025-09-06 19:41:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.285265924s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................XX........................................] duration:
6.436878113s
FAIL (2025-09-06 19:41:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.436902511s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.014357212s
FAIL (2025-09-06 19:41:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 5.014375455s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.676373567s
FAIL (2025-09-06 19:40:58 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.676397793s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
6.18243567s
FAIL (2025-09-06 19:40:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.182459064s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................XX.......................................] duration:
6.476509522s
FAIL (2025-09-06 19:40:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.476532536s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
4.980604195s
FAIL (2025-09-06 19:40:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.980634182s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
5.934713711s
FAIL (2025-09-06 19:40:31 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.934734992s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.917905671s
FAIL (2025-09-06 19:40:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.917933093s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.80973122s
FAIL (2025-09-06 19:39:56 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.809751739s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................XX......................................] duration:
6.29304016s
FAIL (2025-09-06 19:39:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.293067111s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
4.962616637s
FAIL (2025-09-06 19:39:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.962636225s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.60464486s
FAIL (2025-09-06 19:39:25 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.604669689s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration:
6.16875895s
FAIL (2025-09-06 19:39:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.16879012s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.937209726s
FAIL (2025-09-06 19:39:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.937233932s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
6.1778876s
FAIL (2025-09-06 19:38:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.177909082s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.906504483s
FAIL (2025-09-06 19:38:35 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.906527546s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
4.990323834s
FAIL (2025-09-06 19:38:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.990355605s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................XX....................................] duration:
6.338097376s
FAIL (2025-09-06 19:38:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.338128826s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.966413987s
FAIL (2025-09-06 19:37:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.966441049s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.792327327s
FAIL (2025-09-06 19:37:49 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.792348838s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................XX...................................] duration:
6.226476346s
FAIL (2025-09-06 19:37:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.226496493s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
4.998014512s
FAIL (2025-09-06 19:37:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.998041624s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.993872491s
FAIL (2025-09-06 19:37:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.993899171s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
6.949996026s
FAIL (2025-09-06 19:36:55 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.950017837s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
6.017583342s
FAIL (2025-09-06 19:36:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.017598421s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................XX..................................] duration:
6.139197557s
FAIL (2025-09-06 19:36:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.139229187s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.226277872s
FAIL (2025-09-06 19:36:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.226301007s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
4.95972898s
FAIL (2025-09-06 19:36:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.959757744s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.701720326s
FAIL (2025-09-06 19:35:56 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.701742097s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
6.29234956s
FAIL (2025-09-06 19:35:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.29237602s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................XX.................................] duration:
6.223024219s
FAIL (2025-09-06 19:35:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.223054527s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
4.96619704s
FAIL (2025-09-06 19:34:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.966221688s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
6.287186219s
FAIL (2025-09-06 19:34:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.287201067s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................] duration:
6.262566328s
FAIL (2025-09-06 19:34:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.262594121s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.623621495s
FAIL (2025-09-06 19:34:43 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.623663815s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
6.209944636s
FAIL (2025-09-06 19:34:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.209978561s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.893405238s
FAIL (2025-09-06 19:34:10 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.893429795s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
4.938926055s
FAIL (2025-09-06 19:33:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.938955853s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................] duration:
6.119255789s
FAIL (2025-09-06 19:33:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 6.119279193s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.091602987s
FAIL (2025-09-06 19:33:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.09172032s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.824033123s
FAIL (2025-09-06 19:33:41 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.824058201s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
4.999959517s
FAIL (2025-09-06 19:33:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.999989994s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
6.442593812s
FAIL (2025-09-06 19:33:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.442654789s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
4.937923988s
FAIL (2025-09-06 19:33:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ce...
Sep 6 19:22:23.289734766 (5h53m59.329307876s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.289818836 (5h53m59.329391966s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290005133 (5h53m59.329578263s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290226567 (5h53m59.329799687s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290443241 (5h53m59.330016361s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.290688330 (5h53m59.33026145s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291073537 (5h53m59.330646647s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291318446 (5h53m59.330891566s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291612629 (5h53m59.331185749s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.291846556 (5h53m59.331419676s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292082288 (5h53m59.331655398s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292313139 (5h53m59.331886259s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:23.292445112 (5h53m59.332018232s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Uploading piece...
Sep 6 19:22:24.142518010 (5h54m0.18209113s) [upload=5161]: Next returned nil segment
Sep 6 19:22:24.142538239 (5h54m0.182111439s) [upload=5161]: Waiting for error group managing segments...
Sep 6 19:22:24.584764007 (5h54m0.624337127s) [noise=true , address=89.149.201.147:4018 , piece_id=HR2TUPQGNFWXCLJQSVOWC7BLL6BS6OYPMUCUB56KP4SQ5MLRYXPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.597004971 (5h54m0.636578081s) [noise=true , address=89.149.201.147:4022 , piece_id=32J56CM4SLRBGP5GEAKJI52E2MA5ZFHVRR4LGLCXMXGWBABOXZ6A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.611898740 (5h54m0.65147186s) [noise=true , address=89.149.201.147:4015 , piece_id=MFUW6C2JX4FIEXCDQBS2YYAUTBEPTYPR6B7WZCUKR7ADZGCUTKPQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:24.627089939 (5h54m0.666663059s) [noise=true , address=89.149.201.147:4006 , piece_id=IQP4N52WQGQRXQSGYGDWG4CYAIR6YRKSLSG6LLR3KV3XLEQWPYOQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.066470994 (5h54m1.106044114s) [noise=true , address=89.149.201.147:4010 , piece_id=WQ6CIEGT5K22DJIP77TJ42GW4JOWUZ56IB2EYSAPPSTN4BGFOZFA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.078942778 (5h54m1.118515909s) [noise=true , address=89.149.201.147:4012 , piece_id=X4NGFLJBQYI6ZXN374POCBKF7SBERD7NDG466QHMY3DQNAVN7SJA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.098994187 (5h54m1.138567307s) [noise=true , address=185.167.204.205:4009 , piece_id=TUWLDDBBUZZSOSZOAMHI46ZA7A4ISUMMM7RTCGHDXUGJV52HDBFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.120477235 (5h54m1.160050355s) [noise=true , address=185.167.204.206:4054 , piece_id=2ST3FINNFZ4R2Q3RIUYAUB6OOPILKJ4OOUYOZ666YJDK7STWFTTQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.123139198 (5h54m1.162712318s) [noise=true , address=185.167.204.205:4015 , piece_id=MRQXQMT4KD4Y37NYSJFDSMAHPMPD2JZTUJ2OYT4YFTOF4P6SY7YQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132537362 (5h54m1.172110472s) [noise=true , address=185.167.204.206:4062 , piece_id=7EUNJ4PNUI6XWR6OHPOPATS7XWOL5GUQPSGYTJR5QP4VPE6IZIAQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132819862 (5h54m1.172392982s) [noise=true , address=185.167.204.205:4029 , piece_id=RBYI5AZTSQF2WUJBFQ2R7EUSFJKCMYU5GU3BR63Q73YMRMVA5KSA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.132942597 (5h54m1.172515707s) [noise=true , address=185.167.204.205:4028 , piece_id=K5XYB2EZPNA6L75HV3OKEEOK7ZVW42CZ6N7KH2V44R3RGNIZTVAA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136238403 (5h54m1.175811523s) [noise=true , address=185.167.204.206:4049 , piece_id=ENMVGKIXPM6I52GSSAPJU5LIJ45DOPCTHXBY5LA2AXAJ727BQY2A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.136461631 (5h54m1.176034751s) [noise=true , address=185.167.204.206:4069 , piece_id=I2FNPZP6L7GO5KBOHBG56POCUCYJNN2PXRKYXC47XJ37RVOXF2BA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.153140226 (5h54m1.192713346s) [noise=true , address=185.167.204.205:4003 , piece_id=SHHNQ7ZG7BZPY2AGYPDQ2VPGHVSEMYBFYCAOV7FHQFVENHCU327Q, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.155853027 (5h54m1.195426147s) [noise=true , address=185.167.204.205:4021 , piece_id=Z2AAABEJQZLQ6U5LNPP3XAVE6FL55RQNW4AZL24TWZDRV6URL5PQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.158391194 (5h54m1.197964314s) [noise=true , address=185.167.204.206:4051 , piece_id=PFIYNVHXYO4CMMLYLUEZRLGEVUCO7E2XZJYI3T3IOYVH2LU3ZYUA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159460069 (5h54m1.199033189s) [noise=true , address=185.167.204.206:4072 , piece_id=57FDJUSCJW3ERHKKLFZAIDH6OJCF5JXMDV3HTW2MFITPKTL6N3IQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.159576301 (5h54m1.199149421s) [noise=true , address=185.167.204.206:4056 , piece_id=5BTCP5AXYDHPH3H67CLRL6O6QTEVNHNV3OAX24PEQXGHIH4FBPCQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.173190131 (5h54m1.212763251s) [noise=true , address=185.167.204.205:4035 , piece_id=Z2GOT7LNTC72DKJYRPUXOB44IQZWNG73CQSTX3MPZOMHBDH3NC3A, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:25.196868399 (5h54m1.236441519s) [noise=true , address=185.167.204.205:4014 , piece_id=B62EREEN2O2E67RBH2WNWPSGZE7X4FY6OOCPEWHQCACFXTEMX5QQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:28.943781839 (5h54m4.98335495s) [noise=true , address=81.171.14.70:4040 , piece_id=C25ORTJXL2SWIHB3QEL6IBRNVPNSLUNZABF2EVHYES3I3P5GF3WQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:29.674165313 (5h54m5.713738433s) [noise=true , address=81.171.14.70:4029 , piece_id=AJCIN5VV356DWS2624GMPMWSYNAJ6LYTBKLSH4ZPPKNZKCJ566BQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:33.494828525 (5h54m9.534401635s) [noise=true , address=81.171.14.70:4047 , piece_id=QB6BLWLB7MJ4SBR55WUY5U56EPUNUQSC5TRCJC6HHTAL5UYIYUQQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:22:34.505682226 (5h54m10.545255346s) [noise=true , address=81.171.14.70:4048 , piece_id=M4YBGMUV6YWX3YIHPCT3KY4MHXHSYK4BO7IRIQAHIJTGJLQIQPEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: <nil>
Sep 6 19:23:22.460369546 (5h54m58.499942656s) [noise=true , address=81.171.14.70:4027 , piece_id=RHFZX645SZAFLMCWBKWM67FCGYQXAA7PPZSH7OZOSQTDDRSKSRFQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460423148 (5h54m58.499996268s) [noise=true , address=81.171.14.70:4026 , piece_id=Y7ZN3MH2WTY5U7W5PMP4ZR7MI6E3G25W6Y6HMHXLE5AAS333KKHQ, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39084->81.171.14.70:4026: use of closed network connection
Sep 6 19:23:22.460498292 (5h54m58.500071402s) [noise=true , address=81.171.14.70:4045 , piece_id=IE6CUYSI2IE7JW6ROZ3ITKDJJH4FJMPWYNJBI62R5M2YTDINBWEA, seg_pos={0 0}, upload=5161]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Sep 6 19:23:22.460570681 (5h54m58.500143801s) [seg_pos={0 0}, upload=5161]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Sep 6 19:23:22.647339554 (5h54m58.686912684s) [upload=5161]: Done uploading segments...
Sep 6 19:23:22.647370624 (5h54m58.686943744s) [upload=5161]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.937983032s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.656108839s
FAIL (2025-09-06 19:32:35 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.656127285s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................XX..............................] duration:
5.931551593s
FAIL (2025-09-06 19:32:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 1)
======LOGS======
10:08.927228647 (5h41m44.966801767s) [upload=4973]: Next returned nil segment
Sep 6 19:10:08.927250950 (5h41m44.96682407s) [upload=4973]: Waiting for error group managing segments...
Sep 6 19:10:13.284655503 (5h41m49.324228623s) [noise=true , address=45.91.116.6:4973 , piece_id=6TUYDBL7KN2PVR36J24TDSR4MDIGRFXXDBMOURMTZDNK35H3XXUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: <nil>
Sep 6 19:10:17.249957458 (5h41m53.289530578s) [noise=true , address=45.91.116.7:4011 , piece_id=T7WDZW2KQC7NK2A7K6JALXT63OV5EFCN7MXUYRTH6KSKRZEWJWTA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57744->45.91.116.7:4011: use of closed network connection
Sep 6 19:10:17.250029906 (5h41m53.289603026s) [noise=true , address=45.91.116.5:4297 , piece_id=RI3ADQRCXEVHF7VOQRUAE442ERHRXT47YT25EEMKKTH4QXKSDETA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40126->45.91.116.5:4297: use of closed network connection
Sep 6 19:10:17.250057619 (5h41m53.289630739s) [noise=true , address=45.91.116.5:4299 , piece_id=EIUDBBVCJATS4FYSVF6YKPMAFDHTC3LQKY4VXDY6V4HKXZIBQZJA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54978->45.91.116.5:4299: use of closed network connection
Sep 6 19:10:17.250090622 (5h41m53.289663742s) [noise=true , address=77.90.31.12:4590 , piece_id=I74K5HRME3NPEALFSFMXXXHQN7JBRSL7NR5L2JX2ZT5UZBOWG3TA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42556->77.90.31.12:4590: use of closed network connection
Sep 6 19:10:17.250117884 (5h41m53.289691004s) [noise=true , address=45.91.116.5:4298 , piece_id=LYY3IVRI6ZDGPHFRUNH2AIOIU25JLWMB6QAZCZEMR64ZASIQ4O2A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34534->45.91.116.5:4298: use of closed network connection
Sep 6 19:10:17.250137352 (5h41m53.289710472s) [noise=true , address=45.91.116.7:4009 , piece_id=JGHMESK3GMR6APQXGN63FKCNWS45MAKGR3VD7N5DWQBUWBBBELMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37756->45.91.116.7:4009: use of closed network connection
Sep 6 19:10:17.250161588 (5h41m53.289734708s) [noise=true , address=45.91.116.9:4263 , piece_id=DYUUXHMCCPB6HLJNV6TMXQE7CUAQQ4GYJLD3KVRLKY5GYHMKYZ7A, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58844->45.91.116.9:4263: use of closed network connection
Sep 6 19:10:17.250174683 (5h41m53.289747803s) [noise=true , address=77.90.31.16:4735 , piece_id=MSUNXJOYBUWRLVHD3BYU4XSTI5HQR4L2XMTR5UTKMW3HIYIZZDKQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->77.90.31.16:4735: use of closed network connection
Sep 6 19:10:17.250201675 (5h41m53.289774785s) [noise=true , address=45.91.116.6:4974 , piece_id=DZKSEP23ISERCOCRFR5HPK77FON7CDSNKFIJWH45DC6FAEWUASGA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49152->45.91.116.6:4974: use of closed network connection
Sep 6 19:10:17.250228536 (5h41m53.289801656s) [noise=true , address=45.91.116.4:4939 , piece_id=XVKVV3GVXFOYYT7PCP3STTKGW4FXHFVCLBP3OFMLYQDRP3JZGP6Q, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35514->45.91.116.4:4939: use of closed network connection
Sep 6 19:10:17.250241812 (5h41m53.289814922s) [noise=true , address=45.91.116.10:4081 , piece_id=KLRDZBRMNGAG6X6F32RUMSVR6VZGN26734Q4UM5CY633CPTEHNFA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46574->45.91.116.10:4081: use of closed network connection
Sep 6 19:10:17.250277169 (5h41m53.289850289s) [noise=true , address=77.90.31.14:4661 , piece_id=4UXOLUXOKYOVGFMUUJAAAYUPITVQ7CX5SU3HI224PXJ47LQQG4DQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34934->77.90.31.14:4661: use of closed network connection
Sep 6 19:10:17.250296667 (5h41m53.289869787s) [noise=true , address=45.91.116.4:4938 , piece_id=6H6Y7AX2H6HIS4WWXKJD2DJ3K6IB3OTKQTOVBTXRAKHRY57LMOXA, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33786->45.91.116.4:4938: use of closed network connection
Sep 6 19:10:17.250326494 (5h41m53.289899614s) [noise=true , address=77.90.31.19:4842 , piece_id=5BQ5QQPM6OYAKVE6N6ANYWXIQGBZXHDQJ5SGY442JM2D53YFKTMQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49346->77.90.31.19:4842: use of closed network connection
Sep 6 19:10:17.250334198 (5h41m53.289907318s) [noise=true , address=77.90.31.18:4807 , piece_id=FM4RQH4QYCMC64ZEM2NJNCZJPMWVXBHHTIL5UHQ4ZSVIY6K57PUQ, seg_pos={0 0}, upload=4973]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39118->77.90.31.18:4807: use of closed network connection
Sep 6 19:10:17.250351291 (5h41m53.289924412s) [seg_pos={0 0}, upload=4973]: Done waiting for segment. successful: 1 optimal: 13 errs: <nil>
Sep 6 19:10:17.500904160 (5h41m53.54047728s) [upload=4973]: Done uploading segments...
Sep 6 19:10:17.500930721 (5h41m53.540503841s) [upload=4973]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 1)
Duration: 5.931582642s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.337904628s
FAIL (2025-09-06 19:32:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.337925569s
edge
gateway
us-select-1
|