Orbiter History

Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 482225 reports (Page 5799 of 9645)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X........X.........] duration: 8.629595008s FAIL (2025-09-09 08:55:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:48:37.603346736 (67h20m13.642919846s) [upload=59256]: Starting upload Sep 9 08:48:37.603419805 (67h20m13.642992925s) [upload=59256]: Done starting upload Sep 9 08:48:37.603560626 (67h20m13.643133746s) [upload=59256]: Uploading segments... Sep 9 08:48:37.603658763 (67h20m13.643231883s) [upload=59256]: Got next segment. Inline: false Sep 9 08:48:37.603709961 (67h20m13.643283081s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:48:37.603714890 (67h20m13.64328801s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:48:37.986127806 (67h20m14.025700926s) [seg_pos={0 0}, upload=59256]: Begin upload segment... Sep 9 08:48:37.986183582 (67h20m14.025756702s) [seg_pos={0 0}, upload=59256]: Done begin upload segment. Sep 9 08:48:37.986225984 (67h20m14.025799104s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986237676 (67h20m14.025810796s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986694540 (67h20m14.02626765s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986760556 (67h20m14.026333677s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987415671 (67h20m14.026988821s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987669677 (67h20m14.027242797s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987794977 (67h20m14.027368097s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988122874 (67h20m14.027695994s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988373514 (67h20m14.027946634s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988546344 (67h20m14.028119464s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988652898 (67h20m14.028226018s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988886315 (67h20m14.028459435s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989175137 (67h20m14.028748257s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989417802 (67h20m14.028990922s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989681587 (67h20m14.029254707s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989995829 (67h20m14.029568949s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:39.727499450 (67h20m15.76707257s) [upload=59256]: Next returned nil segment Sep 9 08:48:39.727520830 (67h20m15.76709395s) [upload=59256]: Waiting for error group managing segments... Sep 9 08:48:40.014701339 (67h20m16.054274459s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.072180223 (67h20m16.111753343s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.109365648 (67h20m16.148938768s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159800050 (67h20m16.19937316s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159849555 (67h20m16.199422675s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.161483943 (67h20m16.201057063s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.167070705 (67h20m16.206643825s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.232702602 (67h20m16.272275722s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.242044851 (67h20m16.281617971s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.248682735 (67h20m16.288255855s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.257725040 (67h20m16.29729815s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.259052331 (67h20m16.298625451s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266110619 (67h20m16.305683739s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266137240 (67h20m16.30571036s) [seg_pos={0 0}, upload=59256]: Segment reached optimal threshold of 13 pieces. Sep 9 08:48:40.266257359 (67h20m16.305830479s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266314398 (67h20m16.305887518s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266370075 (67h20m16.305943195s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266471809 (67h20m16.30604495s) [seg_pos={0 0}, upload=59256]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:48:40.266560709 (67h20m16.306133829s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:48:40.266565328 (67h20m16.306138448s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:48:40.878820307 (67h20m16.918393437s) [upload=59256]: Done uploading segments... Sep 9 08:48:40.878842610 (67h20m16.91841573s) [upload=59256]: Upload finished. err: <nil> Duration: 8.629643271s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.153558136s FAIL (2025-09-09 08:54:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.153574839s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X........X........] duration: 14.075067192s FAIL (2025-09-09 08:54:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:48:37.603346736 (67h20m13.642919846s) [upload=59256]: Starting upload Sep 9 08:48:37.603419805 (67h20m13.642992925s) [upload=59256]: Done starting upload Sep 9 08:48:37.603560626 (67h20m13.643133746s) [upload=59256]: Uploading segments... Sep 9 08:48:37.603658763 (67h20m13.643231883s) [upload=59256]: Got next segment. Inline: false Sep 9 08:48:37.603709961 (67h20m13.643283081s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:48:37.603714890 (67h20m13.64328801s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:48:37.986127806 (67h20m14.025700926s) [seg_pos={0 0}, upload=59256]: Begin upload segment... Sep 9 08:48:37.986183582 (67h20m14.025756702s) [seg_pos={0 0}, upload=59256]: Done begin upload segment. Sep 9 08:48:37.986225984 (67h20m14.025799104s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986237676 (67h20m14.025810796s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986694540 (67h20m14.02626765s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986760556 (67h20m14.026333677s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987415671 (67h20m14.026988821s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987669677 (67h20m14.027242797s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987794977 (67h20m14.027368097s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988122874 (67h20m14.027695994s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988373514 (67h20m14.027946634s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988546344 (67h20m14.028119464s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988652898 (67h20m14.028226018s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988886315 (67h20m14.028459435s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989175137 (67h20m14.028748257s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989417802 (67h20m14.028990922s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989681587 (67h20m14.029254707s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989995829 (67h20m14.029568949s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:39.727499450 (67h20m15.76707257s) [upload=59256]: Next returned nil segment Sep 9 08:48:39.727520830 (67h20m15.76709395s) [upload=59256]: Waiting for error group managing segments... Sep 9 08:48:40.014701339 (67h20m16.054274459s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.072180223 (67h20m16.111753343s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.109365648 (67h20m16.148938768s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159800050 (67h20m16.19937316s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159849555 (67h20m16.199422675s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.161483943 (67h20m16.201057063s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.167070705 (67h20m16.206643825s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.232702602 (67h20m16.272275722s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.242044851 (67h20m16.281617971s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.248682735 (67h20m16.288255855s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.257725040 (67h20m16.29729815s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.259052331 (67h20m16.298625451s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266110619 (67h20m16.305683739s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266137240 (67h20m16.30571036s) [seg_pos={0 0}, upload=59256]: Segment reached optimal threshold of 13 pieces. Sep 9 08:48:40.266257359 (67h20m16.305830479s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266314398 (67h20m16.305887518s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266370075 (67h20m16.305943195s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266471809 (67h20m16.30604495s) [seg_pos={0 0}, upload=59256]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:48:40.266560709 (67h20m16.306133829s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:48:40.266565328 (67h20m16.306138448s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:48:40.878820307 (67h20m16.918393437s) [upload=59256]: Done uploading segments... Sep 9 08:48:40.878842610 (67h20m16.91841573s) [upload=59256]: Upload finished. err: <nil> Duration: 14.075096126s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2m23.669151072s FAIL (2025-09-09 08:54:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2m23.66917595s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X........X.......] duration: 6.134587049s FAIL (2025-09-09 08:53:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:48:37.603346736 (67h20m13.642919846s) [upload=59256]: Starting upload Sep 9 08:48:37.603419805 (67h20m13.642992925s) [upload=59256]: Done starting upload Sep 9 08:48:37.603560626 (67h20m13.643133746s) [upload=59256]: Uploading segments... Sep 9 08:48:37.603658763 (67h20m13.643231883s) [upload=59256]: Got next segment. Inline: false Sep 9 08:48:37.603709961 (67h20m13.643283081s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:48:37.603714890 (67h20m13.64328801s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:48:37.986127806 (67h20m14.025700926s) [seg_pos={0 0}, upload=59256]: Begin upload segment... Sep 9 08:48:37.986183582 (67h20m14.025756702s) [seg_pos={0 0}, upload=59256]: Done begin upload segment. Sep 9 08:48:37.986225984 (67h20m14.025799104s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986237676 (67h20m14.025810796s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986694540 (67h20m14.02626765s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986760556 (67h20m14.026333677s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987415671 (67h20m14.026988821s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987669677 (67h20m14.027242797s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987794977 (67h20m14.027368097s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988122874 (67h20m14.027695994s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988373514 (67h20m14.027946634s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988546344 (67h20m14.028119464s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988652898 (67h20m14.028226018s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988886315 (67h20m14.028459435s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989175137 (67h20m14.028748257s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989417802 (67h20m14.028990922s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989681587 (67h20m14.029254707s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989995829 (67h20m14.029568949s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:39.727499450 (67h20m15.76707257s) [upload=59256]: Next returned nil segment Sep 9 08:48:39.727520830 (67h20m15.76709395s) [upload=59256]: Waiting for error group managing segments... Sep 9 08:48:40.014701339 (67h20m16.054274459s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.072180223 (67h20m16.111753343s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.109365648 (67h20m16.148938768s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159800050 (67h20m16.19937316s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159849555 (67h20m16.199422675s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.161483943 (67h20m16.201057063s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.167070705 (67h20m16.206643825s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.232702602 (67h20m16.272275722s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.242044851 (67h20m16.281617971s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.248682735 (67h20m16.288255855s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.257725040 (67h20m16.29729815s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.259052331 (67h20m16.298625451s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266110619 (67h20m16.305683739s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266137240 (67h20m16.30571036s) [seg_pos={0 0}, upload=59256]: Segment reached optimal threshold of 13 pieces. Sep 9 08:48:40.266257359 (67h20m16.305830479s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266314398 (67h20m16.305887518s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266370075 (67h20m16.305943195s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266471809 (67h20m16.30604495s) [seg_pos={0 0}, upload=59256]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:48:40.266560709 (67h20m16.306133829s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:48:40.266565328 (67h20m16.306138448s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:48:40.878820307 (67h20m16.918393437s) [upload=59256]: Done uploading segments... Sep 9 08:48:40.878842610 (67h20m16.91841573s) [upload=59256]: Upload finished. err: <nil> Duration: 6.134616586s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X........X......] duration: 29.823269548s FAIL (2025-09-09 08:52:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:48:37.603346736 (67h20m13.642919846s) [upload=59256]: Starting upload Sep 9 08:48:37.603419805 (67h20m13.642992925s) [upload=59256]: Done starting upload Sep 9 08:48:37.603560626 (67h20m13.643133746s) [upload=59256]: Uploading segments... Sep 9 08:48:37.603658763 (67h20m13.643231883s) [upload=59256]: Got next segment. Inline: false Sep 9 08:48:37.603709961 (67h20m13.643283081s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:48:37.603714890 (67h20m13.64328801s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:48:37.986127806 (67h20m14.025700926s) [seg_pos={0 0}, upload=59256]: Begin upload segment... Sep 9 08:48:37.986183582 (67h20m14.025756702s) [seg_pos={0 0}, upload=59256]: Done begin upload segment. Sep 9 08:48:37.986225984 (67h20m14.025799104s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986237676 (67h20m14.025810796s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986694540 (67h20m14.02626765s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986760556 (67h20m14.026333677s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987415671 (67h20m14.026988821s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987669677 (67h20m14.027242797s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987794977 (67h20m14.027368097s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988122874 (67h20m14.027695994s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988373514 (67h20m14.027946634s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988546344 (67h20m14.028119464s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988652898 (67h20m14.028226018s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988886315 (67h20m14.028459435s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989175137 (67h20m14.028748257s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989417802 (67h20m14.028990922s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989681587 (67h20m14.029254707s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989995829 (67h20m14.029568949s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:39.727499450 (67h20m15.76707257s) [upload=59256]: Next returned nil segment Sep 9 08:48:39.727520830 (67h20m15.76709395s) [upload=59256]: Waiting for error group managing segments... Sep 9 08:48:40.014701339 (67h20m16.054274459s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.072180223 (67h20m16.111753343s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.109365648 (67h20m16.148938768s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159800050 (67h20m16.19937316s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159849555 (67h20m16.199422675s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.161483943 (67h20m16.201057063s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.167070705 (67h20m16.206643825s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.232702602 (67h20m16.272275722s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.242044851 (67h20m16.281617971s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.248682735 (67h20m16.288255855s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.257725040 (67h20m16.29729815s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.259052331 (67h20m16.298625451s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266110619 (67h20m16.305683739s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266137240 (67h20m16.30571036s) [seg_pos={0 0}, upload=59256]: Segment reached optimal threshold of 13 pieces. Sep 9 08:48:40.266257359 (67h20m16.305830479s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266314398 (67h20m16.305887518s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266370075 (67h20m16.305943195s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266471809 (67h20m16.30604495s) [seg_pos={0 0}, upload=59256]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:48:40.266560709 (67h20m16.306133829s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:48:40.266565328 (67h20m16.306138448s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:48:40.878820307 (67h20m16.918393437s) [upload=59256]: Done uploading segments... Sep 9 08:48:40.878842610 (67h20m16.91841573s) [upload=59256]: Upload finished. err: <nil> Duration: 29.823299055s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X........X.....] duration: 5.979055762s FAIL (2025-09-09 08:51:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:48:37.603346736 (67h20m13.642919846s) [upload=59256]: Starting upload Sep 9 08:48:37.603419805 (67h20m13.642992925s) [upload=59256]: Done starting upload Sep 9 08:48:37.603560626 (67h20m13.643133746s) [upload=59256]: Uploading segments... Sep 9 08:48:37.603658763 (67h20m13.643231883s) [upload=59256]: Got next segment. Inline: false Sep 9 08:48:37.603709961 (67h20m13.643283081s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:48:37.603714890 (67h20m13.64328801s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:48:37.986127806 (67h20m14.025700926s) [seg_pos={0 0}, upload=59256]: Begin upload segment... Sep 9 08:48:37.986183582 (67h20m14.025756702s) [seg_pos={0 0}, upload=59256]: Done begin upload segment. Sep 9 08:48:37.986225984 (67h20m14.025799104s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986237676 (67h20m14.025810796s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986694540 (67h20m14.02626765s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986760556 (67h20m14.026333677s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987415671 (67h20m14.026988821s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987669677 (67h20m14.027242797s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987794977 (67h20m14.027368097s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988122874 (67h20m14.027695994s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988373514 (67h20m14.027946634s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988546344 (67h20m14.028119464s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988652898 (67h20m14.028226018s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988886315 (67h20m14.028459435s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989175137 (67h20m14.028748257s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989417802 (67h20m14.028990922s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989681587 (67h20m14.029254707s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989995829 (67h20m14.029568949s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:39.727499450 (67h20m15.76707257s) [upload=59256]: Next returned nil segment Sep 9 08:48:39.727520830 (67h20m15.76709395s) [upload=59256]: Waiting for error group managing segments... Sep 9 08:48:40.014701339 (67h20m16.054274459s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.072180223 (67h20m16.111753343s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.109365648 (67h20m16.148938768s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159800050 (67h20m16.19937316s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159849555 (67h20m16.199422675s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.161483943 (67h20m16.201057063s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.167070705 (67h20m16.206643825s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.232702602 (67h20m16.272275722s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.242044851 (67h20m16.281617971s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.248682735 (67h20m16.288255855s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.257725040 (67h20m16.29729815s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.259052331 (67h20m16.298625451s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266110619 (67h20m16.305683739s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266137240 (67h20m16.30571036s) [seg_pos={0 0}, upload=59256]: Segment reached optimal threshold of 13 pieces. Sep 9 08:48:40.266257359 (67h20m16.305830479s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266314398 (67h20m16.305887518s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266370075 (67h20m16.305943195s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266471809 (67h20m16.30604495s) [seg_pos={0 0}, upload=59256]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:48:40.266560709 (67h20m16.306133829s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:48:40.266565328 (67h20m16.306138448s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:48:40.878820307 (67h20m16.918393437s) [upload=59256]: Done uploading segments... Sep 9 08:48:40.878842610 (67h20m16.91841573s) [upload=59256]: Upload finished. err: <nil> Duration: 5.979083314s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X........X....] duration: 6.222983942s FAIL (2025-09-09 08:51:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:48:37.603346736 (67h20m13.642919846s) [upload=59256]: Starting upload Sep 9 08:48:37.603419805 (67h20m13.642992925s) [upload=59256]: Done starting upload Sep 9 08:48:37.603560626 (67h20m13.643133746s) [upload=59256]: Uploading segments... Sep 9 08:48:37.603658763 (67h20m13.643231883s) [upload=59256]: Got next segment. Inline: false Sep 9 08:48:37.603709961 (67h20m13.643283081s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:48:37.603714890 (67h20m13.64328801s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:48:37.986127806 (67h20m14.025700926s) [seg_pos={0 0}, upload=59256]: Begin upload segment... Sep 9 08:48:37.986183582 (67h20m14.025756702s) [seg_pos={0 0}, upload=59256]: Done begin upload segment. Sep 9 08:48:37.986225984 (67h20m14.025799104s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986237676 (67h20m14.025810796s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986694540 (67h20m14.02626765s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986760556 (67h20m14.026333677s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987415671 (67h20m14.026988821s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987669677 (67h20m14.027242797s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987794977 (67h20m14.027368097s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988122874 (67h20m14.027695994s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988373514 (67h20m14.027946634s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988546344 (67h20m14.028119464s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988652898 (67h20m14.028226018s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988886315 (67h20m14.028459435s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989175137 (67h20m14.028748257s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989417802 (67h20m14.028990922s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989681587 (67h20m14.029254707s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989995829 (67h20m14.029568949s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:39.727499450 (67h20m15.76707257s) [upload=59256]: Next returned nil segment Sep 9 08:48:39.727520830 (67h20m15.76709395s) [upload=59256]: Waiting for error group managing segments... Sep 9 08:48:40.014701339 (67h20m16.054274459s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.072180223 (67h20m16.111753343s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.109365648 (67h20m16.148938768s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159800050 (67h20m16.19937316s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159849555 (67h20m16.199422675s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.161483943 (67h20m16.201057063s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.167070705 (67h20m16.206643825s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.232702602 (67h20m16.272275722s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.242044851 (67h20m16.281617971s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.248682735 (67h20m16.288255855s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.257725040 (67h20m16.29729815s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.259052331 (67h20m16.298625451s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266110619 (67h20m16.305683739s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266137240 (67h20m16.30571036s) [seg_pos={0 0}, upload=59256]: Segment reached optimal threshold of 13 pieces. Sep 9 08:48:40.266257359 (67h20m16.305830479s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266314398 (67h20m16.305887518s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266370075 (67h20m16.305943195s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266471809 (67h20m16.30604495s) [seg_pos={0 0}, upload=59256]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:48:40.266560709 (67h20m16.306133829s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:48:40.266565328 (67h20m16.306138448s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:48:40.878820307 (67h20m16.918393437s) [upload=59256]: Done uploading segments... Sep 9 08:48:40.878842610 (67h20m16.91841573s) [upload=59256]: Upload finished. err: <nil> Duration: 6.22300954s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X........X...] duration: 8.986109864s FAIL (2025-09-09 08:50:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:48:37.603346736 (67h20m13.642919846s) [upload=59256]: Starting upload Sep 9 08:48:37.603419805 (67h20m13.642992925s) [upload=59256]: Done starting upload Sep 9 08:48:37.603560626 (67h20m13.643133746s) [upload=59256]: Uploading segments... Sep 9 08:48:37.603658763 (67h20m13.643231883s) [upload=59256]: Got next segment. Inline: false Sep 9 08:48:37.603709961 (67h20m13.643283081s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:48:37.603714890 (67h20m13.64328801s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:48:37.986127806 (67h20m14.025700926s) [seg_pos={0 0}, upload=59256]: Begin upload segment... Sep 9 08:48:37.986183582 (67h20m14.025756702s) [seg_pos={0 0}, upload=59256]: Done begin upload segment. Sep 9 08:48:37.986225984 (67h20m14.025799104s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986237676 (67h20m14.025810796s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986694540 (67h20m14.02626765s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986760556 (67h20m14.026333677s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987415671 (67h20m14.026988821s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987669677 (67h20m14.027242797s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987794977 (67h20m14.027368097s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988122874 (67h20m14.027695994s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988373514 (67h20m14.027946634s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988546344 (67h20m14.028119464s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988652898 (67h20m14.028226018s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988886315 (67h20m14.028459435s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989175137 (67h20m14.028748257s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989417802 (67h20m14.028990922s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989681587 (67h20m14.029254707s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989995829 (67h20m14.029568949s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:39.727499450 (67h20m15.76707257s) [upload=59256]: Next returned nil segment Sep 9 08:48:39.727520830 (67h20m15.76709395s) [upload=59256]: Waiting for error group managing segments... Sep 9 08:48:40.014701339 (67h20m16.054274459s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.072180223 (67h20m16.111753343s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.109365648 (67h20m16.148938768s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159800050 (67h20m16.19937316s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159849555 (67h20m16.199422675s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.161483943 (67h20m16.201057063s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.167070705 (67h20m16.206643825s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.232702602 (67h20m16.272275722s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.242044851 (67h20m16.281617971s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.248682735 (67h20m16.288255855s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.257725040 (67h20m16.29729815s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.259052331 (67h20m16.298625451s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266110619 (67h20m16.305683739s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266137240 (67h20m16.30571036s) [seg_pos={0 0}, upload=59256]: Segment reached optimal threshold of 13 pieces. Sep 9 08:48:40.266257359 (67h20m16.305830479s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266314398 (67h20m16.305887518s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266370075 (67h20m16.305943195s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266471809 (67h20m16.30604495s) [seg_pos={0 0}, upload=59256]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:48:40.266560709 (67h20m16.306133829s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:48:40.266565328 (67h20m16.306138448s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:48:40.878820307 (67h20m16.918393437s) [upload=59256]: Done uploading segments... Sep 9 08:48:40.878842610 (67h20m16.91841573s) [upload=59256]: Upload finished. err: <nil> Duration: 8.986130392s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X........X..] duration: 14.420844819s FAIL (2025-09-09 08:50:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:48:37.603346736 (67h20m13.642919846s) [upload=59256]: Starting upload Sep 9 08:48:37.603419805 (67h20m13.642992925s) [upload=59256]: Done starting upload Sep 9 08:48:37.603560626 (67h20m13.643133746s) [upload=59256]: Uploading segments... Sep 9 08:48:37.603658763 (67h20m13.643231883s) [upload=59256]: Got next segment. Inline: false Sep 9 08:48:37.603709961 (67h20m13.643283081s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:48:37.603714890 (67h20m13.64328801s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:48:37.986127806 (67h20m14.025700926s) [seg_pos={0 0}, upload=59256]: Begin upload segment... Sep 9 08:48:37.986183582 (67h20m14.025756702s) [seg_pos={0 0}, upload=59256]: Done begin upload segment. Sep 9 08:48:37.986225984 (67h20m14.025799104s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986237676 (67h20m14.025810796s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986694540 (67h20m14.02626765s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986760556 (67h20m14.026333677s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987415671 (67h20m14.026988821s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987669677 (67h20m14.027242797s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987794977 (67h20m14.027368097s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988122874 (67h20m14.027695994s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988373514 (67h20m14.027946634s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988546344 (67h20m14.028119464s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988652898 (67h20m14.028226018s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988886315 (67h20m14.028459435s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989175137 (67h20m14.028748257s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989417802 (67h20m14.028990922s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989681587 (67h20m14.029254707s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989995829 (67h20m14.029568949s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:39.727499450 (67h20m15.76707257s) [upload=59256]: Next returned nil segment Sep 9 08:48:39.727520830 (67h20m15.76709395s) [upload=59256]: Waiting for error group managing segments... Sep 9 08:48:40.014701339 (67h20m16.054274459s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.072180223 (67h20m16.111753343s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.109365648 (67h20m16.148938768s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159800050 (67h20m16.19937316s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159849555 (67h20m16.199422675s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.161483943 (67h20m16.201057063s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.167070705 (67h20m16.206643825s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.232702602 (67h20m16.272275722s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.242044851 (67h20m16.281617971s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.248682735 (67h20m16.288255855s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.257725040 (67h20m16.29729815s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.259052331 (67h20m16.298625451s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266110619 (67h20m16.305683739s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266137240 (67h20m16.30571036s) [seg_pos={0 0}, upload=59256]: Segment reached optimal threshold of 13 pieces. Sep 9 08:48:40.266257359 (67h20m16.305830479s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266314398 (67h20m16.305887518s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266370075 (67h20m16.305943195s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266471809 (67h20m16.30604495s) [seg_pos={0 0}, upload=59256]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:48:40.266560709 (67h20m16.306133829s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:48:40.266565328 (67h20m16.306138448s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:48:40.878820307 (67h20m16.918393437s) [upload=59256]: Done uploading segments... Sep 9 08:48:40.878842610 (67h20m16.91841573s) [upload=59256]: Upload finished. err: <nil> Duration: 14.420875337s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X........X.] duration: 6.401522546s FAIL (2025-09-09 08:49:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:48:37.603346736 (67h20m13.642919846s) [upload=59256]: Starting upload Sep 9 08:48:37.603419805 (67h20m13.642992925s) [upload=59256]: Done starting upload Sep 9 08:48:37.603560626 (67h20m13.643133746s) [upload=59256]: Uploading segments... Sep 9 08:48:37.603658763 (67h20m13.643231883s) [upload=59256]: Got next segment. Inline: false Sep 9 08:48:37.603709961 (67h20m13.643283081s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:48:37.603714890 (67h20m13.64328801s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:48:37.986127806 (67h20m14.025700926s) [seg_pos={0 0}, upload=59256]: Begin upload segment... Sep 9 08:48:37.986183582 (67h20m14.025756702s) [seg_pos={0 0}, upload=59256]: Done begin upload segment. Sep 9 08:48:37.986225984 (67h20m14.025799104s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986237676 (67h20m14.025810796s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986694540 (67h20m14.02626765s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986760556 (67h20m14.026333677s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987415671 (67h20m14.026988821s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987669677 (67h20m14.027242797s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987794977 (67h20m14.027368097s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988122874 (67h20m14.027695994s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988373514 (67h20m14.027946634s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988546344 (67h20m14.028119464s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988652898 (67h20m14.028226018s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988886315 (67h20m14.028459435s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989175137 (67h20m14.028748257s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989417802 (67h20m14.028990922s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989681587 (67h20m14.029254707s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989995829 (67h20m14.029568949s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:39.727499450 (67h20m15.76707257s) [upload=59256]: Next returned nil segment Sep 9 08:48:39.727520830 (67h20m15.76709395s) [upload=59256]: Waiting for error group managing segments... Sep 9 08:48:40.014701339 (67h20m16.054274459s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.072180223 (67h20m16.111753343s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.109365648 (67h20m16.148938768s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159800050 (67h20m16.19937316s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159849555 (67h20m16.199422675s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.161483943 (67h20m16.201057063s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.167070705 (67h20m16.206643825s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.232702602 (67h20m16.272275722s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.242044851 (67h20m16.281617971s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.248682735 (67h20m16.288255855s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.257725040 (67h20m16.29729815s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.259052331 (67h20m16.298625451s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266110619 (67h20m16.305683739s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266137240 (67h20m16.30571036s) [seg_pos={0 0}, upload=59256]: Segment reached optimal threshold of 13 pieces. Sep 9 08:48:40.266257359 (67h20m16.305830479s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266314398 (67h20m16.305887518s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266370075 (67h20m16.305943195s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266471809 (67h20m16.30604495s) [seg_pos={0 0}, upload=59256]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:48:40.266560709 (67h20m16.306133829s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:48:40.266565328 (67h20m16.306138448s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:48:40.878820307 (67h20m16.918393437s) [upload=59256]: Done uploading segments... Sep 9 08:48:40.878842610 (67h20m16.91841573s) [upload=59256]: Upload finished. err: <nil> Duration: 6.401541021s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X........X] duration: 30.001858691s FAIL (2025-09-09 08:49:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:48:37.603346736 (67h20m13.642919846s) [upload=59256]: Starting upload Sep 9 08:48:37.603419805 (67h20m13.642992925s) [upload=59256]: Done starting upload Sep 9 08:48:37.603560626 (67h20m13.643133746s) [upload=59256]: Uploading segments... Sep 9 08:48:37.603658763 (67h20m13.643231883s) [upload=59256]: Got next segment. Inline: false Sep 9 08:48:37.603709961 (67h20m13.643283081s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:48:37.603714890 (67h20m13.64328801s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:48:37.986127806 (67h20m14.025700926s) [seg_pos={0 0}, upload=59256]: Begin upload segment... Sep 9 08:48:37.986183582 (67h20m14.025756702s) [seg_pos={0 0}, upload=59256]: Done begin upload segment. Sep 9 08:48:37.986225984 (67h20m14.025799104s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986237676 (67h20m14.025810796s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986694540 (67h20m14.02626765s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.986760556 (67h20m14.026333677s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987415671 (67h20m14.026988821s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987669677 (67h20m14.027242797s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.987794977 (67h20m14.027368097s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988122874 (67h20m14.027695994s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988373514 (67h20m14.027946634s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988546344 (67h20m14.028119464s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988652898 (67h20m14.028226018s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.988886315 (67h20m14.028459435s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989175137 (67h20m14.028748257s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989417802 (67h20m14.028990922s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989681587 (67h20m14.029254707s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:37.989995829 (67h20m14.029568949s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Uploading piece... Sep 9 08:48:39.727499450 (67h20m15.76707257s) [upload=59256]: Next returned nil segment Sep 9 08:48:39.727520830 (67h20m15.76709395s) [upload=59256]: Waiting for error group managing segments... Sep 9 08:48:40.014701339 (67h20m16.054274459s) [noise=true , address=145.79.227.5:4223 , piece_id=AQUNEJGOW5IRVALCKHWGUP6MQMSVWVRO743BIB6MMO2O4NMQY7QQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.072180223 (67h20m16.111753343s) [noise=true , address=145.79.227.6:4257 , piece_id=J623V6NZ3K2ME32GU5NH5BF5N2KALWQP3FSWGIBPAPHZWGK6Z5XQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.109365648 (67h20m16.148938768s) [noise=true , address=145.79.227.15:4874 , piece_id=O2URXXTO5MOQMMAFY2PJDRWZ62QSLEUIF6AY4FY46VQYR7DWQ62A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159800050 (67h20m16.19937316s) [noise=true , address=45.91.116.13:4155 , piece_id=MPMI3FZ6CKRFTT4IFLVD33KR2KV54JEINHK3X4OHJAFPBOHMIDOQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.159849555 (67h20m16.199422675s) [noise=true , address=77.90.31.13:4626 , piece_id=W2VVUE6HAGIXZLVKYTTFU6M4HF5NY6AKCIQHLYC7NK47PJWMCW4Q, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.161483943 (67h20m16.201057063s) [noise=true , address=77.90.31.21:4877 , piece_id=7M72M4RDZJ4M4LWRJ4U4JGJ5ATZP7LU33VP6Q3JBH27JT5NDHPSA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.167070705 (67h20m16.206643825s) [noise=true , address=145.79.227.16:4909 , piece_id=I446II33HHFVB6UGF47TCEJYHKBY2PGEFDX4M43QYTTH5NXSQEXQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.232702602 (67h20m16.272275722s) [noise=true , address=45.91.116.4:4937 , piece_id=5MIQOHSRDKT6UIJWNH2CCAQBAA4OEWKVZVYJYOEBR3VOANVCZO4A, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.242044851 (67h20m16.281617971s) [noise=true , address=77.90.31.18:4806 , piece_id=WVEPZ45N7VFOSZ72ANWCMJ5TVGNZIASG4C2QZMZO2AQYTGO2BGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.248682735 (67h20m16.288255855s) [noise=true , address=77.90.31.21:4878 , piece_id=HWA7W32FWRM77J7FMUGV3EN7XXV2NROBG6SAPJN6BNFHOAOPPPDQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.257725040 (67h20m16.29729815s) [noise=true , address=45.91.116.14:4191 , piece_id=NKITGRVIF77VKSGCXMVRTPZG63CY3NK3DIAFPY7VMBUPA6HNSXEA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.259052331 (67h20m16.298625451s) [noise=true , address=77.90.31.10:4517 , piece_id=SBTLRDAD63V3ZMUYD7CARX4M6VVCMNZJTPOXBKGBHSIEOXGJ6VAQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266110619 (67h20m16.305683739s) [noise=true , address=45.91.116.11:4119 , piece_id=N5QUIECOJ5RKXFK3VO44Z2ACS34A52QQ3TMJXA5VOQGPORNUBIIA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: <nil> Sep 9 08:48:40.266137240 (67h20m16.30571036s) [seg_pos={0 0}, upload=59256]: Segment reached optimal threshold of 13 pieces. Sep 9 08:48:40.266257359 (67h20m16.305830479s) [noise=true , address=45.91.116.11:4118 , piece_id=PWHCNFFDI7O234EO6NCWXYJQG3JPS7DFC7OI4HZ7X224T4LJBGTQ, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266314398 (67h20m16.305887518s) [noise=true , address=45.91.116.6:4974 , piece_id=ZBXZZDMZKQV43RM5SVEM42SHUOHY2MG2XMCSPVBTWLNKGMHVX4LA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266370075 (67h20m16.305943195s) [noise=true , address=77.90.31.12:4590 , piece_id=CYCSONSAYGQ2VLGHP63BIRMTFDRM4W4W6KYTTS2YJLW5WHA75EAA, seg_pos={0 0}, upload=59256]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 08:48:40.266471809 (67h20m16.30604495s) [seg_pos={0 0}, upload=59256]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:48:40.266560709 (67h20m16.306133829s) [upload=59256]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:48:40.266565328 (67h20m16.306138448s) [upload=59256]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:48:40.878820307 (67h20m16.918393437s) [upload=59256]: Done uploading segments... Sep 9 08:48:40.878842610 (67h20m16.91841573s) [upload=59256]: Upload finished. err: <nil> Duration: 30.001878849s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.955725393s FAIL (2025-09-09 08:47:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:42:01.240512738 (67h13m37.280085858s) [upload=59159]: Starting upload Sep 9 08:42:01.240586117 (67h13m37.280159247s) [upload=59159]: Done starting upload Sep 9 08:42:01.240667613 (67h13m37.280240733s) [upload=59159]: Uploading segments... Sep 9 08:42:01.240763137 (67h13m37.280336257s) [upload=59159]: Got next segment. Inline: false Sep 9 08:42:01.240808614 (67h13m37.280381734s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:42:01.240813403 (67h13m37.280386523s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:42:05.715283748 (67h13m41.754856868s) [seg_pos={0 0}, upload=59159]: Begin upload segment... Sep 9 08:42:05.715338443 (67h13m41.754911563s) [seg_pos={0 0}, upload=59159]: Done begin upload segment. Sep 9 08:42:05.715363661 (67h13m41.754936781s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715371265 (67h13m41.754944385s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715451068 (67h13m41.755024188s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715725714 (67h13m41.755298834s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715745722 (67h13m41.755318842s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716054363 (67h13m41.755627483s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716069271 (67h13m41.755642392s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716321354 (67h13m41.755894474s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716582444 (67h13m41.756155564s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716698475 (67h13m41.756271636s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716958013 (67h13m41.756531133s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716971027 (67h13m41.756544147s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717171491 (67h13m41.756744601s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717269017 (67h13m41.756842137s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717589942 (67h13m41.757163062s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717940773 (67h13m41.757513893s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:07.463980127 (67h13m43.503553248s) [upload=59159]: Next returned nil segment Sep 9 08:42:07.463997972 (67h13m43.503571092s) [upload=59159]: Waiting for error group managing segments... Sep 9 08:42:07.749784112 (67h13m43.789357222s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.763462099 (67h13m43.803035219s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.818410801 (67h13m43.857983921s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.834162327 (67h13m43.873735447s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.835596420 (67h13m43.87516954s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.846881198 (67h13m43.886454318s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.896747312 (67h13m43.936320432s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.922408883 (67h13m43.961982003s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966107404 (67h13m44.005680524s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966976207 (67h13m44.006549327s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.971214628 (67h13m44.010787748s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.983039640 (67h13m44.02261276s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992068539 (67h13m44.031641659s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992122782 (67h13m44.031695902s) [seg_pos={0 0}, upload=59159]: Segment reached optimal threshold of 13 pieces. Sep 9 08:42:07.992237723 (67h13m44.031810853s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992279743 (67h13m44.031852863s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992291406 (67h13m44.031864526s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992303338 (67h13m44.031876468s) [seg_pos={0 0}, upload=59159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:42:07.992383341 (67h13m44.031956462s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:42:07.992388151 (67h13m44.031961271s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:42:16.295525023 (67h13m52.335098173s) [upload=59159]: Done uploading segments... Sep 9 08:42:16.295547206 (67h13m52.335120356s) [upload=59159]: Upload finished. err: <nil> Duration: 5.955769077s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 7.606475713s FAIL (2025-09-09 08:46:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:42:01.240512738 (67h13m37.280085858s) [upload=59159]: Starting upload Sep 9 08:42:01.240586117 (67h13m37.280159247s) [upload=59159]: Done starting upload Sep 9 08:42:01.240667613 (67h13m37.280240733s) [upload=59159]: Uploading segments... Sep 9 08:42:01.240763137 (67h13m37.280336257s) [upload=59159]: Got next segment. Inline: false Sep 9 08:42:01.240808614 (67h13m37.280381734s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:42:01.240813403 (67h13m37.280386523s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:42:05.715283748 (67h13m41.754856868s) [seg_pos={0 0}, upload=59159]: Begin upload segment... Sep 9 08:42:05.715338443 (67h13m41.754911563s) [seg_pos={0 0}, upload=59159]: Done begin upload segment. Sep 9 08:42:05.715363661 (67h13m41.754936781s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715371265 (67h13m41.754944385s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715451068 (67h13m41.755024188s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715725714 (67h13m41.755298834s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715745722 (67h13m41.755318842s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716054363 (67h13m41.755627483s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716069271 (67h13m41.755642392s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716321354 (67h13m41.755894474s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716582444 (67h13m41.756155564s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716698475 (67h13m41.756271636s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716958013 (67h13m41.756531133s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716971027 (67h13m41.756544147s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717171491 (67h13m41.756744601s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717269017 (67h13m41.756842137s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717589942 (67h13m41.757163062s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717940773 (67h13m41.757513893s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:07.463980127 (67h13m43.503553248s) [upload=59159]: Next returned nil segment Sep 9 08:42:07.463997972 (67h13m43.503571092s) [upload=59159]: Waiting for error group managing segments... Sep 9 08:42:07.749784112 (67h13m43.789357222s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.763462099 (67h13m43.803035219s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.818410801 (67h13m43.857983921s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.834162327 (67h13m43.873735447s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.835596420 (67h13m43.87516954s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.846881198 (67h13m43.886454318s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.896747312 (67h13m43.936320432s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.922408883 (67h13m43.961982003s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966107404 (67h13m44.005680524s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966976207 (67h13m44.006549327s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.971214628 (67h13m44.010787748s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.983039640 (67h13m44.02261276s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992068539 (67h13m44.031641659s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992122782 (67h13m44.031695902s) [seg_pos={0 0}, upload=59159]: Segment reached optimal threshold of 13 pieces. Sep 9 08:42:07.992237723 (67h13m44.031810853s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992279743 (67h13m44.031852863s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992291406 (67h13m44.031864526s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992303338 (67h13m44.031876468s) [seg_pos={0 0}, upload=59159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:42:07.992383341 (67h13m44.031956462s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:42:07.992388151 (67h13m44.031961271s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:42:16.295525023 (67h13m52.335098173s) [upload=59159]: Done uploading segments... Sep 9 08:42:16.295547206 (67h13m52.335120356s) [upload=59159]: Upload finished. err: <nil> Duration: 7.606504408s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 21.939308913s FAIL (2025-09-09 08:45:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:42:01.240512738 (67h13m37.280085858s) [upload=59159]: Starting upload Sep 9 08:42:01.240586117 (67h13m37.280159247s) [upload=59159]: Done starting upload Sep 9 08:42:01.240667613 (67h13m37.280240733s) [upload=59159]: Uploading segments... Sep 9 08:42:01.240763137 (67h13m37.280336257s) [upload=59159]: Got next segment. Inline: false Sep 9 08:42:01.240808614 (67h13m37.280381734s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:42:01.240813403 (67h13m37.280386523s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:42:05.715283748 (67h13m41.754856868s) [seg_pos={0 0}, upload=59159]: Begin upload segment... Sep 9 08:42:05.715338443 (67h13m41.754911563s) [seg_pos={0 0}, upload=59159]: Done begin upload segment. Sep 9 08:42:05.715363661 (67h13m41.754936781s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715371265 (67h13m41.754944385s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715451068 (67h13m41.755024188s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715725714 (67h13m41.755298834s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715745722 (67h13m41.755318842s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716054363 (67h13m41.755627483s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716069271 (67h13m41.755642392s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716321354 (67h13m41.755894474s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716582444 (67h13m41.756155564s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716698475 (67h13m41.756271636s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716958013 (67h13m41.756531133s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716971027 (67h13m41.756544147s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717171491 (67h13m41.756744601s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717269017 (67h13m41.756842137s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717589942 (67h13m41.757163062s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717940773 (67h13m41.757513893s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:07.463980127 (67h13m43.503553248s) [upload=59159]: Next returned nil segment Sep 9 08:42:07.463997972 (67h13m43.503571092s) [upload=59159]: Waiting for error group managing segments... Sep 9 08:42:07.749784112 (67h13m43.789357222s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.763462099 (67h13m43.803035219s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.818410801 (67h13m43.857983921s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.834162327 (67h13m43.873735447s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.835596420 (67h13m43.87516954s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.846881198 (67h13m43.886454318s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.896747312 (67h13m43.936320432s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.922408883 (67h13m43.961982003s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966107404 (67h13m44.005680524s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966976207 (67h13m44.006549327s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.971214628 (67h13m44.010787748s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.983039640 (67h13m44.02261276s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992068539 (67h13m44.031641659s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992122782 (67h13m44.031695902s) [seg_pos={0 0}, upload=59159]: Segment reached optimal threshold of 13 pieces. Sep 9 08:42:07.992237723 (67h13m44.031810853s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992279743 (67h13m44.031852863s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992291406 (67h13m44.031864526s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992303338 (67h13m44.031876468s) [seg_pos={0 0}, upload=59159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:42:07.992383341 (67h13m44.031956462s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:42:07.992388151 (67h13m44.031961271s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:42:16.295525023 (67h13m52.335098173s) [upload=59159]: Done uploading segments... Sep 9 08:42:16.295547206 (67h13m52.335120356s) [upload=59159]: Upload finished. err: <nil> Duration: 21.939462326s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 22.910696068s FAIL (2025-09-09 08:45:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:42:01.240512738 (67h13m37.280085858s) [upload=59159]: Starting upload Sep 9 08:42:01.240586117 (67h13m37.280159247s) [upload=59159]: Done starting upload Sep 9 08:42:01.240667613 (67h13m37.280240733s) [upload=59159]: Uploading segments... Sep 9 08:42:01.240763137 (67h13m37.280336257s) [upload=59159]: Got next segment. Inline: false Sep 9 08:42:01.240808614 (67h13m37.280381734s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:42:01.240813403 (67h13m37.280386523s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:42:05.715283748 (67h13m41.754856868s) [seg_pos={0 0}, upload=59159]: Begin upload segment... Sep 9 08:42:05.715338443 (67h13m41.754911563s) [seg_pos={0 0}, upload=59159]: Done begin upload segment. Sep 9 08:42:05.715363661 (67h13m41.754936781s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715371265 (67h13m41.754944385s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715451068 (67h13m41.755024188s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715725714 (67h13m41.755298834s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715745722 (67h13m41.755318842s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716054363 (67h13m41.755627483s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716069271 (67h13m41.755642392s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716321354 (67h13m41.755894474s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716582444 (67h13m41.756155564s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716698475 (67h13m41.756271636s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716958013 (67h13m41.756531133s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716971027 (67h13m41.756544147s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717171491 (67h13m41.756744601s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717269017 (67h13m41.756842137s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717589942 (67h13m41.757163062s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717940773 (67h13m41.757513893s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:07.463980127 (67h13m43.503553248s) [upload=59159]: Next returned nil segment Sep 9 08:42:07.463997972 (67h13m43.503571092s) [upload=59159]: Waiting for error group managing segments... Sep 9 08:42:07.749784112 (67h13m43.789357222s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.763462099 (67h13m43.803035219s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.818410801 (67h13m43.857983921s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.834162327 (67h13m43.873735447s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.835596420 (67h13m43.87516954s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.846881198 (67h13m43.886454318s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.896747312 (67h13m43.936320432s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.922408883 (67h13m43.961982003s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966107404 (67h13m44.005680524s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966976207 (67h13m44.006549327s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.971214628 (67h13m44.010787748s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.983039640 (67h13m44.02261276s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992068539 (67h13m44.031641659s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992122782 (67h13m44.031695902s) [seg_pos={0 0}, upload=59159]: Segment reached optimal threshold of 13 pieces. Sep 9 08:42:07.992237723 (67h13m44.031810853s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992279743 (67h13m44.031852863s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992291406 (67h13m44.031864526s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992303338 (67h13m44.031876468s) [seg_pos={0 0}, upload=59159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:42:07.992383341 (67h13m44.031956462s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:42:07.992388151 (67h13m44.031961271s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:42:16.295525023 (67h13m52.335098173s) [upload=59159]: Done uploading segments... Sep 9 08:42:16.295547206 (67h13m52.335120356s) [upload=59159]: Upload finished. err: <nil> Duration: 22.910725374s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 21.0763094s FAIL (2025-09-09 08:44:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:42:01.240512738 (67h13m37.280085858s) [upload=59159]: Starting upload Sep 9 08:42:01.240586117 (67h13m37.280159247s) [upload=59159]: Done starting upload Sep 9 08:42:01.240667613 (67h13m37.280240733s) [upload=59159]: Uploading segments... Sep 9 08:42:01.240763137 (67h13m37.280336257s) [upload=59159]: Got next segment. Inline: false Sep 9 08:42:01.240808614 (67h13m37.280381734s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:42:01.240813403 (67h13m37.280386523s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:42:05.715283748 (67h13m41.754856868s) [seg_pos={0 0}, upload=59159]: Begin upload segment... Sep 9 08:42:05.715338443 (67h13m41.754911563s) [seg_pos={0 0}, upload=59159]: Done begin upload segment. Sep 9 08:42:05.715363661 (67h13m41.754936781s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715371265 (67h13m41.754944385s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715451068 (67h13m41.755024188s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715725714 (67h13m41.755298834s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715745722 (67h13m41.755318842s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716054363 (67h13m41.755627483s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716069271 (67h13m41.755642392s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716321354 (67h13m41.755894474s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716582444 (67h13m41.756155564s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716698475 (67h13m41.756271636s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716958013 (67h13m41.756531133s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716971027 (67h13m41.756544147s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717171491 (67h13m41.756744601s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717269017 (67h13m41.756842137s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717589942 (67h13m41.757163062s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717940773 (67h13m41.757513893s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:07.463980127 (67h13m43.503553248s) [upload=59159]: Next returned nil segment Sep 9 08:42:07.463997972 (67h13m43.503571092s) [upload=59159]: Waiting for error group managing segments... Sep 9 08:42:07.749784112 (67h13m43.789357222s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.763462099 (67h13m43.803035219s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.818410801 (67h13m43.857983921s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.834162327 (67h13m43.873735447s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.835596420 (67h13m43.87516954s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.846881198 (67h13m43.886454318s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.896747312 (67h13m43.936320432s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.922408883 (67h13m43.961982003s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966107404 (67h13m44.005680524s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966976207 (67h13m44.006549327s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.971214628 (67h13m44.010787748s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.983039640 (67h13m44.02261276s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992068539 (67h13m44.031641659s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992122782 (67h13m44.031695902s) [seg_pos={0 0}, upload=59159]: Segment reached optimal threshold of 13 pieces. Sep 9 08:42:07.992237723 (67h13m44.031810853s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992279743 (67h13m44.031852863s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992291406 (67h13m44.031864526s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992303338 (67h13m44.031876468s) [seg_pos={0 0}, upload=59159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:42:07.992383341 (67h13m44.031956462s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:42:07.992388151 (67h13m44.031961271s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:42:16.295525023 (67h13m52.335098173s) [upload=59159]: Done uploading segments... Sep 9 08:42:16.295547206 (67h13m52.335120356s) [upload=59159]: Upload finished. err: <nil> Duration: 21.076358883s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 15.679982136s FAIL (2025-09-09 08:44:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:42:01.240512738 (67h13m37.280085858s) [upload=59159]: Starting upload Sep 9 08:42:01.240586117 (67h13m37.280159247s) [upload=59159]: Done starting upload Sep 9 08:42:01.240667613 (67h13m37.280240733s) [upload=59159]: Uploading segments... Sep 9 08:42:01.240763137 (67h13m37.280336257s) [upload=59159]: Got next segment. Inline: false Sep 9 08:42:01.240808614 (67h13m37.280381734s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:42:01.240813403 (67h13m37.280386523s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:42:05.715283748 (67h13m41.754856868s) [seg_pos={0 0}, upload=59159]: Begin upload segment... Sep 9 08:42:05.715338443 (67h13m41.754911563s) [seg_pos={0 0}, upload=59159]: Done begin upload segment. Sep 9 08:42:05.715363661 (67h13m41.754936781s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715371265 (67h13m41.754944385s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715451068 (67h13m41.755024188s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715725714 (67h13m41.755298834s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715745722 (67h13m41.755318842s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716054363 (67h13m41.755627483s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716069271 (67h13m41.755642392s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716321354 (67h13m41.755894474s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716582444 (67h13m41.756155564s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716698475 (67h13m41.756271636s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716958013 (67h13m41.756531133s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716971027 (67h13m41.756544147s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717171491 (67h13m41.756744601s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717269017 (67h13m41.756842137s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717589942 (67h13m41.757163062s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717940773 (67h13m41.757513893s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:07.463980127 (67h13m43.503553248s) [upload=59159]: Next returned nil segment Sep 9 08:42:07.463997972 (67h13m43.503571092s) [upload=59159]: Waiting for error group managing segments... Sep 9 08:42:07.749784112 (67h13m43.789357222s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.763462099 (67h13m43.803035219s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.818410801 (67h13m43.857983921s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.834162327 (67h13m43.873735447s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.835596420 (67h13m43.87516954s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.846881198 (67h13m43.886454318s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.896747312 (67h13m43.936320432s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.922408883 (67h13m43.961982003s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966107404 (67h13m44.005680524s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966976207 (67h13m44.006549327s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.971214628 (67h13m44.010787748s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.983039640 (67h13m44.02261276s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992068539 (67h13m44.031641659s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992122782 (67h13m44.031695902s) [seg_pos={0 0}, upload=59159]: Segment reached optimal threshold of 13 pieces. Sep 9 08:42:07.992237723 (67h13m44.031810853s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992279743 (67h13m44.031852863s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992291406 (67h13m44.031864526s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992303338 (67h13m44.031876468s) [seg_pos={0 0}, upload=59159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:42:07.992383341 (67h13m44.031956462s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:42:07.992388151 (67h13m44.031961271s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:42:16.295525023 (67h13m52.335098173s) [upload=59159]: Done uploading segments... Sep 9 08:42:16.295547206 (67h13m52.335120356s) [upload=59159]: Upload finished. err: <nil> Duration: 15.680008786s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 16.037404714s FAIL (2025-09-09 08:43:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:42:01.240512738 (67h13m37.280085858s) [upload=59159]: Starting upload Sep 9 08:42:01.240586117 (67h13m37.280159247s) [upload=59159]: Done starting upload Sep 9 08:42:01.240667613 (67h13m37.280240733s) [upload=59159]: Uploading segments... Sep 9 08:42:01.240763137 (67h13m37.280336257s) [upload=59159]: Got next segment. Inline: false Sep 9 08:42:01.240808614 (67h13m37.280381734s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:42:01.240813403 (67h13m37.280386523s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:42:05.715283748 (67h13m41.754856868s) [seg_pos={0 0}, upload=59159]: Begin upload segment... Sep 9 08:42:05.715338443 (67h13m41.754911563s) [seg_pos={0 0}, upload=59159]: Done begin upload segment. Sep 9 08:42:05.715363661 (67h13m41.754936781s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715371265 (67h13m41.754944385s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715451068 (67h13m41.755024188s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715725714 (67h13m41.755298834s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715745722 (67h13m41.755318842s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716054363 (67h13m41.755627483s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716069271 (67h13m41.755642392s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716321354 (67h13m41.755894474s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716582444 (67h13m41.756155564s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716698475 (67h13m41.756271636s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716958013 (67h13m41.756531133s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716971027 (67h13m41.756544147s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717171491 (67h13m41.756744601s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717269017 (67h13m41.756842137s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717589942 (67h13m41.757163062s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717940773 (67h13m41.757513893s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:07.463980127 (67h13m43.503553248s) [upload=59159]: Next returned nil segment Sep 9 08:42:07.463997972 (67h13m43.503571092s) [upload=59159]: Waiting for error group managing segments... Sep 9 08:42:07.749784112 (67h13m43.789357222s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.763462099 (67h13m43.803035219s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.818410801 (67h13m43.857983921s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.834162327 (67h13m43.873735447s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.835596420 (67h13m43.87516954s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.846881198 (67h13m43.886454318s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.896747312 (67h13m43.936320432s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.922408883 (67h13m43.961982003s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966107404 (67h13m44.005680524s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966976207 (67h13m44.006549327s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.971214628 (67h13m44.010787748s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.983039640 (67h13m44.02261276s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992068539 (67h13m44.031641659s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992122782 (67h13m44.031695902s) [seg_pos={0 0}, upload=59159]: Segment reached optimal threshold of 13 pieces. Sep 9 08:42:07.992237723 (67h13m44.031810853s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992279743 (67h13m44.031852863s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992291406 (67h13m44.031864526s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992303338 (67h13m44.031876468s) [seg_pos={0 0}, upload=59159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:42:07.992383341 (67h13m44.031956462s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:42:07.992388151 (67h13m44.031961271s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:42:16.295525023 (67h13m52.335098173s) [upload=59159]: Done uploading segments... Sep 9 08:42:16.295547206 (67h13m52.335120356s) [upload=59159]: Upload finished. err: <nil> Duration: 16.037439911s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 10.737152311s FAIL (2025-09-09 08:43:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:42:01.240512738 (67h13m37.280085858s) [upload=59159]: Starting upload Sep 9 08:42:01.240586117 (67h13m37.280159247s) [upload=59159]: Done starting upload Sep 9 08:42:01.240667613 (67h13m37.280240733s) [upload=59159]: Uploading segments... Sep 9 08:42:01.240763137 (67h13m37.280336257s) [upload=59159]: Got next segment. Inline: false Sep 9 08:42:01.240808614 (67h13m37.280381734s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:42:01.240813403 (67h13m37.280386523s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:42:05.715283748 (67h13m41.754856868s) [seg_pos={0 0}, upload=59159]: Begin upload segment... Sep 9 08:42:05.715338443 (67h13m41.754911563s) [seg_pos={0 0}, upload=59159]: Done begin upload segment. Sep 9 08:42:05.715363661 (67h13m41.754936781s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715371265 (67h13m41.754944385s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715451068 (67h13m41.755024188s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715725714 (67h13m41.755298834s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715745722 (67h13m41.755318842s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716054363 (67h13m41.755627483s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716069271 (67h13m41.755642392s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716321354 (67h13m41.755894474s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716582444 (67h13m41.756155564s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716698475 (67h13m41.756271636s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716958013 (67h13m41.756531133s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716971027 (67h13m41.756544147s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717171491 (67h13m41.756744601s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717269017 (67h13m41.756842137s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717589942 (67h13m41.757163062s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717940773 (67h13m41.757513893s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:07.463980127 (67h13m43.503553248s) [upload=59159]: Next returned nil segment Sep 9 08:42:07.463997972 (67h13m43.503571092s) [upload=59159]: Waiting for error group managing segments... Sep 9 08:42:07.749784112 (67h13m43.789357222s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.763462099 (67h13m43.803035219s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.818410801 (67h13m43.857983921s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.834162327 (67h13m43.873735447s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.835596420 (67h13m43.87516954s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.846881198 (67h13m43.886454318s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.896747312 (67h13m43.936320432s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.922408883 (67h13m43.961982003s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966107404 (67h13m44.005680524s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966976207 (67h13m44.006549327s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.971214628 (67h13m44.010787748s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.983039640 (67h13m44.02261276s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992068539 (67h13m44.031641659s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992122782 (67h13m44.031695902s) [seg_pos={0 0}, upload=59159]: Segment reached optimal threshold of 13 pieces. Sep 9 08:42:07.992237723 (67h13m44.031810853s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992279743 (67h13m44.031852863s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992291406 (67h13m44.031864526s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992303338 (67h13m44.031876468s) [seg_pos={0 0}, upload=59159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:42:07.992383341 (67h13m44.031956462s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:42:07.992388151 (67h13m44.031961271s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:42:16.295525023 (67h13m52.335098173s) [upload=59159]: Done uploading segments... Sep 9 08:42:16.295547206 (67h13m52.335120356s) [upload=59159]: Upload finished. err: <nil> Duration: 10.737182128s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.003258176s FAIL (2025-09-09 08:42:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 08:42:01.240512738 (67h13m37.280085858s) [upload=59159]: Starting upload Sep 9 08:42:01.240586117 (67h13m37.280159247s) [upload=59159]: Done starting upload Sep 9 08:42:01.240667613 (67h13m37.280240733s) [upload=59159]: Uploading segments... Sep 9 08:42:01.240763137 (67h13m37.280336257s) [upload=59159]: Got next segment. Inline: false Sep 9 08:42:01.240808614 (67h13m37.280381734s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 08:42:01.240813403 (67h13m37.280386523s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 08:42:05.715283748 (67h13m41.754856868s) [seg_pos={0 0}, upload=59159]: Begin upload segment... Sep 9 08:42:05.715338443 (67h13m41.754911563s) [seg_pos={0 0}, upload=59159]: Done begin upload segment. Sep 9 08:42:05.715363661 (67h13m41.754936781s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715371265 (67h13m41.754944385s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715451068 (67h13m41.755024188s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715725714 (67h13m41.755298834s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.715745722 (67h13m41.755318842s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716054363 (67h13m41.755627483s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716069271 (67h13m41.755642392s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716321354 (67h13m41.755894474s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716582444 (67h13m41.756155564s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716698475 (67h13m41.756271636s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716958013 (67h13m41.756531133s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.716971027 (67h13m41.756544147s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717171491 (67h13m41.756744601s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717269017 (67h13m41.756842137s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717589942 (67h13m41.757163062s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:05.717940773 (67h13m41.757513893s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Uploading piece... Sep 9 08:42:07.463980127 (67h13m43.503553248s) [upload=59159]: Next returned nil segment Sep 9 08:42:07.463997972 (67h13m43.503571092s) [upload=59159]: Waiting for error group managing segments... Sep 9 08:42:07.749784112 (67h13m43.789357222s) [noise=true , address=145.79.227.2:4114 , piece_id=4EXMQ72BEAPARZU6WPXKDJEM5UMKHJ5YF27S4X7QBZRS5TJNAINQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.763462099 (67h13m43.803035219s) [noise=true , address=145.79.227.15:4873 , piece_id=7SZXBCVB5KFDU6MMV6AT4QGCXPNNIEAV4WDBLOIEFQGB45QVMWHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.818410801 (67h13m43.857983921s) [noise=true , address=145.79.227.5:4222 , piece_id=XRBDOIQZMZINFCW7ZHZ6BJEGUK6TW7D6VXREFF3CNWSRE5OVJAPA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.834162327 (67h13m43.873735447s) [noise=true , address=145.79.227.13:4801 , piece_id=E2DVWMDL5APOIODEP54QFTIW3THD32QS3ZYFC6ECFKRGEW6VKLNA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.835596420 (67h13m43.87516954s) [noise=true , address=145.79.227.3:4151 , piece_id=X6Y6AWW5Z3BFZOOUSRNSJBJ6B5QDAZ2IJO4J4FMNLJA2A2UHIBHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.846881198 (67h13m43.886454318s) [noise=true , address=145.79.227.16:4911 , piece_id=CRQTLZKF4NZF73V7FA5YYJA5TKQXHPNI3IN4GC5AH7OMP557RTSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.896747312 (67h13m43.936320432s) [noise=true , address=145.79.227.6:4259 , piece_id=W362VWH2D5C77J6NGQRLL7ANUEBVM5GHQZRABZT2S5GIF6ONZPSQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.922408883 (67h13m43.961982003s) [noise=true , address=45.91.116.9:4261 , piece_id=YIKMY55PUBAUQGYJ7D7GBTI7OUDMNLXDVBPHM6T7VM5NFAMXWYLA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966107404 (67h13m44.005680524s) [noise=true , address=45.91.116.11:4118 , piece_id=N5HQDZCDCGNFCOIKK4572HRY3MGTHTTEUH5PHD4S7JUOOD67CJDA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.966976207 (67h13m44.006549327s) [noise=true , address=45.91.116.6:4973 , piece_id=7EUQKVQQ3CKURLISDMXDIC3TEO26UTMNMGPJHCNPNOLFOKGDAOHQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.971214628 (67h13m44.010787748s) [noise=true , address=45.91.116.4:4939 , piece_id=KTMV2E6CGBD4ENAOZQVMIAQ6PERWTRQSYJDEMBCADME7YCMCDF6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.983039640 (67h13m44.02261276s) [noise=true , address=45.91.116.14:4189 , piece_id=Q77USWGPQ4CZMXYC6OC5I4CFTJAWWVG3GDLYMUTGIJHLBEAYFCMQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992068539 (67h13m44.031641659s) [noise=true , address=77.90.31.15:4698 , piece_id=6CIJD2IKIONT4EVTLI4G7SVUSTXJJWWX6HULO7FFSMVZRZNGQTRQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: <nil> Sep 9 08:42:07.992122782 (67h13m44.031695902s) [seg_pos={0 0}, upload=59159]: Segment reached optimal threshold of 13 pieces. Sep 9 08:42:07.992237723 (67h13m44.031810853s) [noise=true , address=45.91.116.11:4119 , piece_id=UROQS6X4MWRPKOSGKXXXLYY5AX3XYCTFGPAH5INTHBO4PUSZ43HQ, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992279743 (67h13m44.031852863s) [noise=true , address=45.91.116.5:4298 , piece_id=OU3ZSOFRV6DMDIOLJZ5LPNSRZIRSXPIKNKN4M5XFIMT5FNEILG6A, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992291406 (67h13m44.031864526s) [noise=true , address=45.91.116.13:4153 , piece_id=JE7BNKKDKY6BEX67DIM642D4D4UFALEUIB5MFELYT6W5IHSL7EGA, seg_pos={0 0}, upload=59159]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 9 08:42:07.992303338 (67h13m44.031876468s) [seg_pos={0 0}, upload=59159]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 08:42:07.992383341 (67h13m44.031956462s) [upload=59159]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 08:42:07.992388151 (67h13m44.031961271s) [upload=59159]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 08:42:16.295525023 (67h13m52.335098173s) [upload=59159]: Done uploading segments... Sep 9 08:42:16.295547206 (67h13m52.335120356s) [upload=59159]: Upload finished. err: <nil> Duration: 30.003285579s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.222800714s FAIL (2025-09-09 07:26:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.222824489s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.139866198s FAIL (2025-09-09 07:26:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.139892086s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.555577313s FAIL (2025-09-09 07:25:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.555606989s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.008096374s FAIL (2025-09-09 07:24:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.008122625s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.359241845s FAIL (2025-09-09 07:24:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.359264859s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.155250618s FAIL (2025-09-09 07:23:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.155300494s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.184996542s FAIL (2025-09-09 07:23:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.185016078s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.237859713s FAIL (2025-09-09 07:22:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.237887216s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.260704668s FAIL (2025-09-09 07:21:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.260741078s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.083542935s FAIL (2025-09-09 07:21:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.083570647s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 7.406187455s FAIL (2025-09-09 07:20:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.406210068s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.728769292s FAIL (2025-09-09 07:20:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.728795803s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 7.16831705s FAIL (2025-09-09 07:19:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.168344112s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.323047402s FAIL (2025-09-09 07:18:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.323069404s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 7.29953794s FAIL (2025-09-09 07:17:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.299561296s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 7.67677383s FAIL (2025-09-09 07:17:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.676798596s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.513830975s FAIL (2025-09-09 07:16:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.513848329s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.598288278s FAIL (2025-09-09 07:15:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.59835713s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.273887036s FAIL (2025-09-09 07:15:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.273900983s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.027280028s FAIL (2025-09-09 07:14:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.027299284s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.13118276s FAIL (2025-09-09 07:14:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.131213841s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.076670694s FAIL (2025-09-09 07:13:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.076686334s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.41836552s FAIL (2025-09-09 07:12:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.418388193s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.333434339s FAIL (2025-09-09 07:12:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.33345624s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.26702015s FAIL (2025-09-09 07:11:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.267045028s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.421579573s FAIL (2025-09-09 07:10:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.421617655s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.307006586s FAIL (2025-09-09 07:10:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.307049339s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.362446896s FAIL (2025-09-09 07:09:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.362469409s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.35045s FAIL (2025-09-09 07:08:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.350474277s core uplink us-select-1 us1-placement-20

1
...
5797
5798
5799
5800
5801
...
9645