Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 8.57336475s FAIL (2025-10-05 13:00:03 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 8.573405427s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 23.088008664s FAIL (2025-10-05 12:59:14 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 23.08803783s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 19.575569884s FAIL (2025-10-05 12:59:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Oct 5 12:58:37.920171151 (287h27m23.382263624s) [upload=252995]: Starting upload Oct 5 12:58:37.920287333 (287h27m23.382379816s) [upload=252995]: Done starting upload Oct 5 12:58:37.920520997 (287h27m23.382613481s) [upload=252995]: Uploading segments... Oct 5 12:58:37.920575251 (287h27m23.382667734s) [upload=252995]: Got next segment. Inline: false Oct 5 12:58:37.920857839 (287h27m23.382950322s) [upload=252995]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 12:58:37.920865283 (287h27m23.382957766s) [upload=252995]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 12:58:53.723403647 (287h27m39.18549613s) [upload=252995]: Next segment err: context deadline exceeded Oct 5 12:58:53.723485683 (287h27m39.185578166s) [upload=252995]: Done uploading segments... Oct 5 12:58:53.723503097 (287h27m39.18559558s) [upload=252995]: Upload finished. err: context deadline exceeded Duration: 19.57559332s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.000497687s FAIL (2025-10-05 12:58:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Oct 5 12:58:37.920171151 (287h27m23.382263624s) [upload=252995]: Starting upload Oct 5 12:58:37.920287333 (287h27m23.382379816s) [upload=252995]: Done starting upload Oct 5 12:58:37.920520997 (287h27m23.382613481s) [upload=252995]: Uploading segments... Oct 5 12:58:37.920575251 (287h27m23.382667734s) [upload=252995]: Got next segment. Inline: false Oct 5 12:58:37.920857839 (287h27m23.382950322s) [upload=252995]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 12:58:37.920865283 (287h27m23.382957766s) [upload=252995]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 12:58:53.723403647 (287h27m39.18549613s) [upload=252995]: Next segment err: context deadline exceeded Oct 5 12:58:53.723485683 (287h27m39.185578166s) [upload=252995]: Done uploading segments... Oct 5 12:58:53.723503097 (287h27m39.18559558s) [upload=252995]: Upload finished. err: context deadline exceeded Duration: 30.000513438s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001321806s FAIL (2025-10-05 12:58:43 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.001345451s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002161395s FAIL (2025-10-05 12:58:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: VKFL3SRJYK56MEIG67O5HG6NR35EZJ2D4LFDWIR5R6RO6IIXYLUQ) context deadline exceeded; piecestore: (Node ID: 1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, Piece ID: UOKOCJPANUTNPX5U5WGSBCDL7FF3Q46N2FQEUSGAGHSPT2GKGTXQ) context deadline exceeded ======LOGS====== Oct 5 12:57:54.281404990 (287h26m39.743497463s) [upload=252985]: Starting upload Oct 5 12:57:54.281489991 (287h26m39.743582464s) [upload=252985]: Done starting upload Oct 5 12:57:54.281582348 (287h26m39.743674831s) [upload=252985]: Uploading segments... Oct 5 12:57:54.281687017 (287h26m39.74377949s) [upload=252985]: Got next segment. Inline: false Oct 5 12:57:54.281738925 (287h26m39.743831398s) [upload=252985]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 12:57:54.281743895 (287h26m39.743836379s) [upload=252985]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 12:57:54.623555253 (287h26m40.085647746s) [seg_pos={0 0}, upload=252985]: Begin upload segment... Oct 5 12:57:54.623620558 (287h26m40.085713041s) [seg_pos={0 0}, upload=252985]: Done begin upload segment. Oct 5 12:57:54.623648832 (287h26m40.085741315s) [noise=true , address=145.79.227.7:4295 , piece_id=OMGCOSKHAUJQ2IJXRQGGT7HHR45RNAUAN6MRSGIHQ5LKPG5QAKXA, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.623664160 (287h26m40.085756644s) [noise=true , address=45.91.116.8:4045 , piece_id=SGXC3S7LNLF4DSCHW57VUJEW5WJHZFSB2UCZCK7OPBHBPW3JLXCA, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.624138905 (287h26m40.086231388s) [noise=true , address=45.91.116.13:4155 , piece_id=NBZ5E7VPYL3A3SR4VHB4OP7DRR5T7JB5XW4FHMIGIKLRC63246WA, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.624547052 (287h26m40.086639535s) [noise=true , address=77.90.31.14:4662 , piece_id=YVQCSHKSXE3KTAFU2E7D23LTZLYFC33V44WLTOKUJYWRKAJ5PTGQ, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.625036995 (287h26m40.087129478s) [noise=true , address=45.91.116.7:4010 , piece_id=5OUNOTBHHUZRWN7PVGF4UJEUGE4CRT6627N6PMWDVDDAOSOEGENQ, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.625419674 (287h26m40.087512157s) [noise=true , address=77.90.31.16:4734 , piece_id=XWLRTT3JT2SVEHXXDB6ICZY6SVNXWQ3OADSZEUFOUKUWQFZDQJQA, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.625865453 (287h26m40.087957936s) [noise=true , address=145.79.227.11:4731 , piece_id=WOY3HPTYJ6XLVG24WJDAXNQBBY2IPGAFPR5HMPAC3VJDT55KZ7ZQ, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.626335798 (287h26m40.088428281s) [noise=true , address=45.91.116.12:4225 , piece_id=VKFL3SRJYK56MEIG67O5HG6NR35EZJ2D4LFDWIR5R6RO6IIXYLUQ, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.626800093 (287h26m40.088892576s) [noise=true , address=145.79.227.14:4837 , piece_id=AMEQKCKHR6Q52IKNVX3EW5HVFRETU3GMAXR2TEUS2AKI5OWKOCHA, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.627271039 (287h26m40.089363522s) [noise=true , address=77.90.31.18:4806 , piece_id=UOKOCJPANUTNPX5U5WGSBCDL7FF3Q46N2FQEUSGAGHSPT2GKGTXQ, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.629368052 (287h26m40.091460525s) [noise=true , address=77.90.31.10:4520 , piece_id=MU5TG5XCB262J3VK3FJFIRKF2N5QO2CF43Q4QLAIR7NF2UXA7JYQ, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.629388221 (287h26m40.091480714s) [noise=true , address=145.79.227.18:4006 , piece_id=MXB6IVSBPSMHK24C5TDOC4L2R33TNPSDPSWXQHCX4GRNSFJ7WAZQ, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.631055846 (287h26m40.093148329s) [noise=true , address=45.91.116.11:4117 , piece_id=Y6EU25CHFV7NDXF6YBWR6KUXI5HAK5FT5CTPDYCYLVCFTMKXEHYQ, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.632804926 (287h26m40.09489742s) [noise=true , address=145.79.227.7:4294 , piece_id=AHNTVOZOBV7NJHQCGOYZYC5URUI3AY6CJUBX4TH2MJM6DZHSBMVA, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.636043573 (287h26m40.098136056s) [noise=true , address=145.79.227.19:4077 , piece_id=HFZJMGTPKUVSQEQSCOCARG2IKPRAWXJEQO4CFXSSYIJVKJCN3YIA, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:54.638007193 (287h26m40.100099676s) [noise=true , address=77.90.31.13:4628 , piece_id=3SDLOIEHIGSHIIWFUY2VZWMJAOEPMD7YI66CDA2JC4QUMEQBACJA, seg_pos={0 0}, upload=252985]: Uploading piece... Oct 5 12:57:56.267397798 (287h26m41.729490271s) [upload=252985]: Next returned nil segment Oct 5 12:57:56.267419049 (287h26m41.729511532s) [upload=252985]: Waiting for error group managing segments... Oct 5 12:57:56.659990503 (287h26m42.122082986s) [noise=true , address=145.79.227.7:4295 , piece_id=OMGCOSKHAUJQ2IJXRQGGT7HHR45RNAUAN6MRSGIHQ5LKPG5QAKXA, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.661657448 (287h26m42.123749931s) [noise=true , address=145.79.227.11:4731 , piece_id=WOY3HPTYJ6XLVG24WJDAXNQBBY2IPGAFPR5HMPAC3VJDT55KZ7ZQ, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.662597387 (287h26m42.12468987s) [noise=true , address=145.79.227.14:4837 , piece_id=AMEQKCKHR6Q52IKNVX3EW5HVFRETU3GMAXR2TEUS2AKI5OWKOCHA, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.666730127 (287h26m42.1288226s) [noise=true , address=145.79.227.18:4006 , piece_id=MXB6IVSBPSMHK24C5TDOC4L2R33TNPSDPSWXQHCX4GRNSFJ7WAZQ, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.688868603 (287h26m42.150961086s) [noise=true , address=145.79.227.19:4077 , piece_id=HFZJMGTPKUVSQEQSCOCARG2IKPRAWXJEQO4CFXSSYIJVKJCN3YIA, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.688973883 (287h26m42.151066366s) [noise=true , address=145.79.227.7:4294 , piece_id=AHNTVOZOBV7NJHQCGOYZYC5URUI3AY6CJUBX4TH2MJM6DZHSBMVA, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.759247096 (287h26m42.221339579s) [noise=true , address=45.91.116.11:4117 , piece_id=Y6EU25CHFV7NDXF6YBWR6KUXI5HAK5FT5CTPDYCYLVCFTMKXEHYQ, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.771684598 (287h26m42.233777082s) [noise=true , address=45.91.116.7:4010 , piece_id=5OUNOTBHHUZRWN7PVGF4UJEUGE4CRT6627N6PMWDVDDAOSOEGENQ, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.781456336 (287h26m42.243548809s) [noise=true , address=45.91.116.8:4045 , piece_id=SGXC3S7LNLF4DSCHW57VUJEW5WJHZFSB2UCZCK7OPBHBPW3JLXCA, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.865920411 (287h26m42.328012894s) [noise=true , address=45.91.116.12:4225 , piece_id=VKFL3SRJYK56MEIG67O5HG6NR35EZJ2D4LFDWIR5R6RO6IIXYLUQ, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.866137434 (287h26m42.328229917s) [noise=true , address=77.90.31.16:4734 , piece_id=XWLRTT3JT2SVEHXXDB6ICZY6SVNXWQ3OADSZEUFOUKUWQFZDQJQA, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.869238158 (287h26m42.331330631s) [noise=true , address=45.91.116.13:4155 , piece_id=NBZ5E7VPYL3A3SR4VHB4OP7DRR5T7JB5XW4FHMIGIKLRC63246WA, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.913434195 (287h26m42.375526678s) [noise=true , address=77.90.31.18:4806 , piece_id=UOKOCJPANUTNPX5U5WGSBCDL7FF3Q46N2FQEUSGAGHSPT2GKGTXQ, seg_pos={0 0}, upload=252985]: Done uploading piece. err: <nil> Oct 5 12:57:56.913516572 (287h26m42.375609055s) [seg_pos={0 0}, upload=252985]: Segment reached optimal threshold of 13 pieces. Oct 5 12:57:56.913745438 (287h26m42.375837921s) [noise=true , address=77.90.31.13:4628 , piece_id=3SDLOIEHIGSHIIWFUY2VZWMJAOEPMD7YI66CDA2JC4QUMEQBACJA, seg_pos={0 0}, upload=252985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Oct 5 12:57:56.913757551 (287h26m42.375850034s) [noise=true , address=77.90.31.13:4628 , piece_id=3SDLOIEHIGSHIIWFUY2VZWMJAOEPMD7YI66CDA2JC4QUMEQBACJA, seg_pos={0 0}, upload=252985]: Long tail cancellation due to optimal threshold Oct 5 12:57:56.913927665 (287h26m42.376020168s) [noise=true , address=77.90.31.10:4520 , piece_id=MU5TG5XCB262J3VK3FJFIRKF2N5QO2CF43Q4QLAIR7NF2UXA7JYQ, seg_pos={0 0}, upload=252985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp): protocol: expected piece hash; context canceled; EOF Oct 5 12:57:56.913936662 (287h26m42.376029155s) [noise=true , address=77.90.31.10:4520 , piece_id=MU5TG5XCB262J3VK3FJFIRKF2N5QO2CF43Q4QLAIR7NF2UXA7JYQ, seg_pos={0 0}, upload=252985]: Long tail cancellation due to optimal threshold Oct 5 12:57:56.914019369 (287h26m42.376111852s) [noise=true , address=77.90.31.14:4662 , piece_id=YVQCSHKSXE3KTAFU2E7D23LTZLYFC33V44WLTOKUJYWRKAJ5PTGQ, seg_pos={0 0}, upload=252985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: expected piece hash; context canceled; EOF Oct 5 12:57:56.914027014 (287h26m42.376119497s) [noise=true , address=77.90.31.14:4662 , piece_id=YVQCSHKSXE3KTAFU2E7D23LTZLYFC33V44WLTOKUJYWRKAJ5PTGQ, seg_pos={0 0}, upload=252985]: Long tail cancellation due to optimal threshold Oct 5 12:57:56.914043986 (287h26m42.376136469s) [seg_pos={0 0}, upload=252985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 12:57:56.914164816 (287h26m42.37625731s) [upload=252985]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 12:57:56.914172701 (287h26m42.376265184s) [upload=252985]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 12:57:57.268698881 (287h26m42.730791354s) [upload=252985]: Done uploading segments... Oct 5 12:57:57.268823007 (287h26m42.73091548s) [upload=252985]: Upload finished. err: <nil> Duration: 30.00218971s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.260678917s FAIL (2025-10-05 10:30:10 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.260713664s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.905565153s FAIL (2025-10-05 10:29:53 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.905587526s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.521662405s FAIL (2025-10-05 10:29:07 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.521699685s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.84384664s FAIL (2025-10-05 10:28:04 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.843980736s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.201817516s FAIL (2025-10-05 10:27:19 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.201850177s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.307613789s FAIL (2025-10-05 10:26:16 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.307644608s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 9.231341144s FAIL (2025-10-05 10:25:12 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 9.231376591s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 8.239935134s FAIL (2025-10-05 10:24:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 8.239970011s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 7.85171616s FAIL (2025-10-05 10:23:26 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 7.851761737s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 11.218020444s FAIL (2025-10-05 10:23:03 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 11.218056844s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 7.650850446s FAIL (2025-10-05 10:22:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 7.650882306s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.716813908s FAIL (2025-10-05 10:22:10 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.716849856s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.012471918s FAIL (2025-10-05 10:21:02 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.012507857s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 8.173582828s FAIL (2025-10-05 10:20:40 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 8.173632382s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.022322224s FAIL (2025-10-05 10:19:45 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.022370086s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 12.54595914s FAIL (2025-10-05 10:18:51 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 12.545991242s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 13.996889863s FAIL (2025-10-05 10:18:05 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 13.996917818s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.945479356s FAIL (2025-10-05 10:17:30 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.945512921s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.710372599s FAIL (2025-10-05 10:16:26 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.710455465s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.968124532s FAIL (2025-10-05 10:16:04 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.968182963s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.220194834s FAIL (2025-10-05 10:15:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.220225182s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.39755582s FAIL (2025-10-05 10:14:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.397588743s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.181857874s FAIL (2025-10-05 10:13:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.181915885s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.232704948s FAIL (2025-10-05 10:12:51 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.232739784s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 12.991392014s FAIL (2025-10-05 10:11:54 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 12.991422871s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 7.13503655s FAIL (2025-10-05 10:10:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 7.135062079s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.054803622s FAIL (2025-10-05 10:09:19 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.054831164s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.043774728s FAIL (2025-10-05 10:08:08 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.043807652s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.8729387s FAIL (2025-10-05 10:07:13 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 5.872969998s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.869401934s FAIL (2025-10-05 10:06:14 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 5.869430879s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.496784328s FAIL (2025-10-05 10:05:08 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.496823272s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.85571438s FAIL (2025-10-05 10:03:53 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 5.855752984s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.687163021s FAIL (2025-10-05 10:03:30 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.687213667s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.905758293s FAIL (2025-10-05 10:03:00 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 5.90579369s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.947985751s FAIL (2025-10-05 10:02:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 5.948014146s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.149687015s FAIL (2025-10-05 10:01:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.1497259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.046907948s FAIL (2025-10-05 10:00:36 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.046946471s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.025199882s FAIL (2025-10-05 09:59:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.025232456s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.035379275s FAIL (2025-10-05 09:58:31 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.035413641s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.966964184s FAIL (2025-10-05 09:57:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 5.966997636s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.052443399s FAIL (2025-10-05 09:57:15 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.05247058s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.013325825s FAIL (2025-10-05 09:56:08 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 6.013358777s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.908691852s FAIL (2025-10-05 09:55:09 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 5.913893755s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.963513031s FAIL (2025-10-05 09:54:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 5 09:41:49.374201666 (284h10m34.836294149s) [upload=250109]: Starting upload Oct 5 09:41:49.374284735 (284h10m34.836377208s) [upload=250109]: Done starting upload Oct 5 09:41:49.374407638 (284h10m34.836500111s) [upload=250109]: Uploading segments... Oct 5 09:41:49.374581690 (284h10m34.836674173s) [upload=250109]: Got next segment. Inline: false Oct 5 09:41:49.374699825 (284h10m34.836792298s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 5 09:41:49.374710585 (284h10m34.836803058s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 5 09:41:49.703421827 (284h10m35.165514311s) [seg_pos={0 0}, upload=250109]: Begin upload segment... Oct 5 09:41:49.703478676 (284h10m35.165571159s) [seg_pos={0 0}, upload=250109]: Done begin upload segment. Oct 5 09:41:49.703509515 (284h10m35.165602008s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.704676236 (284h10m35.166768719s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.705718681 (284h10m35.167811164s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706242759 (284h10m35.168335242s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.706737251 (284h10m35.168829734s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707207025 (284h10m35.169299508s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.707643427 (284h10m35.16973591s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708162044 (284h10m35.170254528s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.708654732 (284h10m35.170747216s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.709085342 (284h10m35.171177825s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.713925489 (284h10m35.176017972s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.714500915 (284h10m35.176593398s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.715509275 (284h10m35.177601758s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.716333193 (284h10m35.178425676s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717028417 (284h10m35.1791209s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:49.717657885 (284h10m35.179750368s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Uploading piece... Oct 5 09:41:51.450372533 (284h10m36.912465016s) [upload=250109]: Next returned nil segment Oct 5 09:41:51.450396629 (284h10m36.912489112s) [upload=250109]: Waiting for error group managing segments... Oct 5 09:41:51.738884479 (284h10m37.200976953s) [noise=true , address=145.79.227.2:4113 , piece_id=RATG7UJXDZUKS72Q46L3THN4VCQHRGRWV72PWMXCQABSM2XLOOVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.742096876 (284h10m37.204189359s) [noise=true , address=145.79.227.14:4837 , piece_id=NBESP2LMI2PHJZBOAZPQSVXW733O3HYCJHC2QG5AIU4YNIOBYTCA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.744610654 (284h10m37.206703137s) [noise=true , address=145.79.227.11:4731 , piece_id=R3VVGVYX4IXCQ2QNNYMP322RGTFZNF42IK2JR6NFA72EUBQL3UVA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.748812794 (284h10m37.210905268s) [noise=true , address=145.79.227.13:4801 , piece_id=6MHGTSIFY76E43I7SGF6HIARQ7MUEQSYSRWJ2J322TKTT6WM3LYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.750559861 (284h10m37.212652334s) [noise=true , address=145.79.227.16:4909 , piece_id=J3GITY2KC5LXQ7TM6A7AK6NNM3XI4RTD4PLUPXO7Z6OXIHD6Z4YQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.757346073 (284h10m37.219438546s) [noise=true , address=145.79.227.4:4185 , piece_id=OU4IDUL3TRAPUKPRNYDGDUFVH6RW57HIVFS2E2VWOVHGRDYP5O2A, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.758283298 (284h10m37.220375771s) [noise=true , address=145.79.227.14:4840 , piece_id=MZKZ5S6NBDBWKYY3UO6AFAMPPL3E5OJUEVNFVGXGRW3F74KLMKYA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.770592738 (284h10m37.232685221s) [noise=true , address=145.79.227.17:4969 , piece_id=HPVK2W2HBPER363ZVTJVEEZ2OQ2UDMHFAABMFYTU7S2CXMLAFGTQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.779227910 (284h10m37.241320393s) [noise=true , address=145.79.227.18:4006 , piece_id=DYPSLSJ3WJVVMVXVCQGEMYMJR345EUYBYIJIWLBVHDHNZ2YVULUA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.884742198 (284h10m37.346834681s) [noise=true , address=77.90.31.10:4519 , piece_id=5IGZVUEOKHPOBLNQH6VLXTVAXDYWD6PYNYOABBVFP4ZFXDMS5QDQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.908624243 (284h10m37.370716726s) [noise=true , address=45.91.116.6:4975 , piece_id=2YBEFZUGHB76NR2Y4GND5T2YZBDIWTGAKEO2SIPGYEWZ3N5TUEGA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.912737916 (284h10m37.374830389s) [noise=true , address=45.91.116.11:4117 , piece_id=CXKJ5NEMSCIBHI5Q4D64JNAHRWXVX24GFDYIBZB6UK4CLJMJJPYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939172212 (284h10m37.401264685s) [noise=true , address=45.91.116.7:4009 , piece_id=BORDOQCOUHACZKXCUS7HD27Y4OFS73LOHZK3SPQBZCRCUOOYBQMA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: <nil> Oct 5 09:41:51.939203601 (284h10m37.401296074s) [seg_pos={0 0}, upload=250109]: Segment reached optimal threshold of 13 pieces. Oct 5 09:41:51.939375418 (284h10m37.401467932s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939391570 (284h10m37.401484093s) [noise=true , address=45.91.116.14:4190 , piece_id=5KNYASATQ2IDFUFUODE5A4QU3MVENYC6ZL52PVOUQSI4PJC2A6VQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939471882 (284h10m37.401564355s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939494846 (284h10m37.401587319s) [noise=true , address=45.91.116.7:4011 , piece_id=3URSORS3RDQVB6VOTDN32EH6GIXIAS7PTQSEIGPZTOLL4IJALRYQ, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939541335 (284h10m37.401633838s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Oct 5 09:41:51.939550792 (284h10m37.401643275s) [noise=true , address=77.90.31.12:4590 , piece_id=XRRBLNMMUEC5CYYTLQCYRS6U5VLIA5URVOWZD3F2IE3DDJHAN4ZA, seg_pos={0 0}, upload=250109]: Long tail cancellation due to optimal threshold Oct 5 09:41:51.939571332 (284h10m37.401663805s) [seg_pos={0 0}, upload=250109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 5 09:41:51.939643449 (284h10m37.401735932s) [upload=250109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 5 09:41:51.939649230 (284h10m37.401741713s) [upload=250109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 5 09:41:52.260812150 (284h10m37.722904643s) [upload=250109]: Done uploading segments... Oct 5 09:41:52.260839180 (284h10m37.722931663s) [upload=250109]: Upload finished. err: <nil> Duration: 5.963551594s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)