Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 9.574796902s FAIL (2025-09-04 13:53:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 9.574813594s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 12.07049282s FAIL (2025-09-04 13:52:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 12.070519872s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 14.5645085s FAIL (2025-09-04 13:51:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 14.56454022s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 10.630820742s FAIL (2025-09-04 13:51:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 10.630852113s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 15.438427437s FAIL (2025-09-04 13:50:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 15.438453709s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 7.800651793s FAIL (2025-09-04 13:49:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 7.800676901s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 12.454806245s FAIL (2025-09-04 13:48:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 12.454845792s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 7.418844906s FAIL (2025-09-04 13:48:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 7.418872088s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 8.471545819s FAIL (2025-09-04 13:47:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 8.471571158s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 15.272893552s FAIL (2025-09-04 13:46:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 15.272921425s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 17.201282924s FAIL (2025-09-04 13:45:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 17.201320687s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 10.376812938s FAIL (2025-09-04 13:43:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 10.376843266s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 11.740022597s FAIL (2025-09-04 13:43:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 11.740053877s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 11.960842368s FAIL (2025-09-04 13:42:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 11.960867097s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 15.831739388s FAIL (2025-09-04 13:41:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 15.831833077s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 8.706165885s FAIL (2025-09-04 13:40:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 8.706199559s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 8.382159122s FAIL (2025-09-04 13:40:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 8.382185241s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.268758237s FAIL (2025-09-04 13:39:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 6.268788052s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.372937165s FAIL (2025-09-04 13:38:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 6.372964007s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 16.679711026s FAIL (2025-09-04 13:38:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 16.679790858s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 12.282143192s FAIL (2025-09-04 13:37:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 12.282169072s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 9.664514482s FAIL (2025-09-04 13:36:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 9.664543458s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 8.759465115s FAIL (2025-09-04 13:36:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 8.759491275s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 13.347486057s FAIL (2025-09-04 13:36:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 13.347511284s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 11.789538482s FAIL (2025-09-04 13:35:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 11.78959972s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.406949695s FAIL (2025-09-04 13:35:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 6.407215495s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.909165179s FAIL (2025-09-04 13:34:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 6.909198913s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 9.961204161s FAIL (2025-09-04 13:33:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 9.961231773s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 12.043593514s FAIL (2025-09-04 13:33:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 12.043609085s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 21.14193005s FAIL (2025-09-04 13:33:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 21.14195645s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 8.279556069s FAIL (2025-09-04 13:32:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 8.279584515s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 27.925252464s FAIL (2025-09-04 13:31:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 27.925277412s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 10.180536227s FAIL (2025-09-04 13:30:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 10.180558819s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 19.156750288s FAIL (2025-09-04 13:30:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 19.156772671s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.976644374s FAIL (2025-09-04 13:29:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 6.97666319s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 8.696040121s FAIL (2025-09-04 13:28:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 8.696067623s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 14.817878058s FAIL (2025-09-04 13:27:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 14.817903746s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 16.782870819s FAIL (2025-09-04 13:27:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 16.782901819s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 14.127525671s FAIL (2025-09-04 13:26:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 14.127554136s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001802125s FAIL (2025-09-04 13:25:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 4 13:25:23.862675566 (143h17m20.542871135s) [upload=126015]: Starting upload Sep 4 13:25:23.862752063 (143h17m20.542947632s) [upload=126015]: Done starting upload Sep 4 13:25:23.862872162 (143h17m20.543067731s) [upload=126015]: Uploading segments... Sep 4 13:25:23.862965341 (143h17m20.5431609s) [upload=126015]: Got next segment. Inline: false Sep 4 13:25:23.863008463 (143h17m20.543204022s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 13:25:23.863013583 (143h17m20.543209153s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 13:25:24.190531030 (143h17m20.870726599s) [seg_pos={0 0}, upload=126015]: Begin upload segment... Sep 4 13:25:24.190598520 (143h17m20.870794079s) [seg_pos={0 0}, upload=126015]: Done begin upload segment. Sep 4 13:25:24.190630641 (143h17m20.87082621s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191147270 (143h17m20.871342839s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.191537387 (143h17m20.871732956s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192139178 (143h17m20.872334737s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192574331 (143h17m20.8727699s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.192924932 (143h17m20.873120501s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193292064 (143h17m20.873487633s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.193754830 (143h17m20.873950399s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194159685 (143h17m20.874355254s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194453176 (143h17m20.874648736s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194754162 (143h17m20.874949731s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.194969775 (143h17m20.875165344s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195164087 (143h17m20.875359656s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195388035 (143h17m20.875583604s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195645438 (143h17m20.875841007s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:24.195879967 (143h17m20.876075537s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Uploading piece... Sep 4 13:25:25.954825152 (143h17m22.635020711s) [upload=126015]: Next returned nil segment Sep 4 13:25:25.954876480 (143h17m22.635072039s) [upload=126015]: Waiting for error group managing segments... Sep 4 13:25:26.350173267 (143h17m23.030368866s) [noise=true , address=45.91.116.5:4297 , piece_id=T2WVWTLAS4DQKHULOFXVA42SZSVOORQJYNEUTO4VDAB7XBONLBNA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.354730208 (143h17m23.034925767s) [noise=true , address=45.91.116.5:4299 , piece_id=46TR4QNVGIKEENPEMH5S7MSK6RFV4QSUM4FDZJKWYMQP3WJP6MDQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.405334978 (143h17m23.085530547s) [noise=true , address=45.91.116.13:4155 , piece_id=L5FGWHJ6XDNIC22BP5EJN3PFQ7SXAWVLM3GN5THWSQ5WJONTX6ZQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.428132598 (143h17m23.108328217s) [noise=true , address=45.91.116.11:4119 , piece_id=BQ2ISIEEKAJINM7D75SOBQBZ2N6P72XU2UEXSIHTQ65LYRVOSRLA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.430233700 (143h17m23.110429259s) [noise=true , address=45.91.116.13:4153 , piece_id=5DISEBWEWUHXNRRRYWBU5HUNHP37EDQ2JOI2APMGI5OBTFBKF4JQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.436973459 (143h17m23.117169028s) [noise=true , address=45.91.116.4:4937 , piece_id=MNNP3PP66H673YGETSXL5X37YGFV6KL73CQ4IF65SNJ5BRHPDCTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.452598873 (143h17m23.132794432s) [noise=true , address=77.90.31.19:4842 , piece_id=47ECD624PB2FNX5TTJTEXISBYA7CGYNUJ5XMURCP5ZFBJ3M2VCJA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.500699340 (143h17m23.180894909s) [noise=true , address=77.90.31.14:4662 , piece_id=I6KWQI6GXBEPIXYRYKYDHUZYEG4KMLXHH2HBJGKUI25EKG7GCSTA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.501321581 (143h17m23.18151715s) [noise=true , address=45.91.116.7:4011 , piece_id=XEZ6EK54WT2RQ6TSDQF6ONWHIR4TFYYVMR23EOLGYPUGV4Q524IQ, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.525650963 (143h17m23.205846532s) [noise=true , address=77.90.31.18:4806 , piece_id=E4TFKP26IDFV7SMLRG4FRWJHUAQPVFOMSSI4PXSWQCBWTVLLWBOA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.535736465 (143h17m23.215932034s) [noise=true , address=45.91.116.4:4940 , piece_id=VTMGJTMKKUTVEYOGUGORAWC2QLHRQG2I4Y5KMGLVGIO2SZNH2IDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:26.568530518 (143h17m23.248726087s) [noise=true , address=45.91.116.14:4189 , piece_id=SYGKA4G3KPTBB4IEKNMUSCAYDQZOUUIJZHMGEU72PM5ETG53YO3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086719441 (143h17m23.76691501s) [noise=true , address=77.90.31.21:4878 , piece_id=3YBCYVBPO6YLUC4TSHM36ALU2EFREPHKAUH7R5AG2P2FXTN3TL3A, seg_pos={0 0}, upload=126015]: Done uploading piece. err: <nil> Sep 4 13:25:27.086745851 (143h17m23.76694142s) [seg_pos={0 0}, upload=126015]: Segment reached optimal threshold of 13 pieces. Sep 4 13:25:27.086869718 (143h17m23.767065287s) [noise=true , address=77.90.31.16:4733 , piece_id=5KDXH6W7C5T7QBYGNC7HQENOL4A27MGZUSUODUM3N2XOGLBEOCDA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.086928401 (143h17m23.76712397s) [noise=true , address=45.91.116.12:4226 , piece_id=YPERH6WCO62ZNUG5EMG5WL4AA2Z324WR47EC7QDTUOO5DX4D7ZHA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087095611 (143h17m23.76729121s) [noise=true , address=77.90.31.16:4735 , piece_id=7VWLEJZOX6KHKKPM33IBJJ2HTCT3NVYCZ7HGAGFZZV6RGQMKLASA, seg_pos={0 0}, upload=126015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 4 13:25:27.087175263 (143h17m23.767370862s) [seg_pos={0 0}, upload=126015]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 4 13:25:27.087290724 (143h17m23.767486313s) [upload=126015]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 4 13:25:27.087300442 (143h17m23.767496051s) [upload=126015]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 4 13:25:27.461576076 (143h17m24.141771646s) [upload=126015]: Done uploading segments... Sep 4 13:25:27.461596866 (143h17m24.141792426s) [upload=126015]: Upload finished. err: <nil> Duration: 30.001816693s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.812103677s FAIL (2025-09-03 21:29:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ments... Sep 3 20:46:46.507740238 (126h38m43.187935807s) [upload=111394]: Got next segment. Inline: false Sep 3 20:46:46.507796726 (126h38m43.187992295s) [upload=111394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 20:46:46.507801555 (126h38m43.187997124s) [upload=111394]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 20:46:46.986921972 (126h38m43.667117531s) [seg_pos={0 0}, upload=111394]: Begin upload segment... Sep 3 20:46:46.986970355 (126h38m43.667165924s) [seg_pos={0 0}, upload=111394]: Done begin upload segment. Sep 3 20:46:46.986993188 (126h38m43.667188757s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987025891 (126h38m43.66722149s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987379036 (126h38m43.667574605s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987539673 (126h38m43.667735242s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987676215 (126h38m43.667871784s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987898590 (126h38m43.668094159s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988014642 (126h38m43.668210211s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988236147 (126h38m43.668431716s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988315938 (126h38m43.668511507s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988564003 (126h38m43.668759572s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988571097 (126h38m43.668766656s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988913612 (126h38m43.669109181s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989158771 (126h38m43.66935433s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989460519 (126h38m43.669656088s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.991957024 (126h38m43.672152593s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992228534 (126h38m43.672424103s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992436231 (126h38m43.6726318s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992636855 (126h38m43.672832424s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:48.098682631 (126h38m44.7788782s) [upload=111394]: Next returned nil segment Sep 3 20:46:48.098703030 (126h38m44.778898599s) [upload=111394]: Waiting for error group managing segments... Sep 3 20:46:48.406789573 (126h38m45.086985142s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.962952774 (126h38m45.643148343s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.988648514 (126h38m45.668844073s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.017026896 (126h38m45.697222465s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.056150074 (126h38m45.736345643s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.062962407 (126h38m45.743157976s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.101039653 (126h38m45.781235222s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.112535798 (126h38m45.792731367s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.143844376 (126h38m45.824039945s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.168296035 (126h38m45.848491604s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.196090980 (126h38m45.876286539s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.246375251 (126h38m45.92657082s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:27.065483691 (126h39m23.74567926s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:45.822355459 (126h39m42.502551018s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:104.36.82.55:4219): protocol: rpc: dial tcp 104.36.82.55:4219: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822406667 (126h39m42.502602236s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12faeDgwCPWMN4w1RxSPWwPTGNbaKnA87zYX8dhFRgm7F2YLYbV, address:104.36.82.48:4575): protocol: rpc: dial tcp 104.36.82.48:4575: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822416856 (126h39m42.502612415s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822440732 (126h39m42.502636291s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1FdJoeW4vejiQx1QkQ1nCkApgQaW6fB66d2usAYVfFuK1PPmRP, address:104.36.82.16:4317): protocol: write tcp 188.166.225.170:40168->104.36.82.16:4317: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822469587 (126h39m42.502665156s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1GEmVgDhSMyFLPY5qcc4gGqD9amUzhZ2iduyWusUSrVjLgBu1T, address:104.36.82.22:4535): protocol: rpc: dial tcp 104.36.82.22:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822492131 (126h39m42.5026877s) [seg_pos={0 0}, upload=111394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Sep 3 20:47:46.061841650 (126h39m42.742037219s) [upload=111394]: Done uploading segments... Sep 3 20:47:46.061868962 (126h39m42.742064532s) [upload=111394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.812134355s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.817752225s FAIL (2025-09-03 21:28:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ments... Sep 3 20:46:46.507740238 (126h38m43.187935807s) [upload=111394]: Got next segment. Inline: false Sep 3 20:46:46.507796726 (126h38m43.187992295s) [upload=111394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 20:46:46.507801555 (126h38m43.187997124s) [upload=111394]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 20:46:46.986921972 (126h38m43.667117531s) [seg_pos={0 0}, upload=111394]: Begin upload segment... Sep 3 20:46:46.986970355 (126h38m43.667165924s) [seg_pos={0 0}, upload=111394]: Done begin upload segment. Sep 3 20:46:46.986993188 (126h38m43.667188757s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987025891 (126h38m43.66722149s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987379036 (126h38m43.667574605s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987539673 (126h38m43.667735242s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987676215 (126h38m43.667871784s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987898590 (126h38m43.668094159s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988014642 (126h38m43.668210211s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988236147 (126h38m43.668431716s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988315938 (126h38m43.668511507s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988564003 (126h38m43.668759572s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988571097 (126h38m43.668766656s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988913612 (126h38m43.669109181s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989158771 (126h38m43.66935433s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989460519 (126h38m43.669656088s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.991957024 (126h38m43.672152593s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992228534 (126h38m43.672424103s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992436231 (126h38m43.6726318s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992636855 (126h38m43.672832424s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:48.098682631 (126h38m44.7788782s) [upload=111394]: Next returned nil segment Sep 3 20:46:48.098703030 (126h38m44.778898599s) [upload=111394]: Waiting for error group managing segments... Sep 3 20:46:48.406789573 (126h38m45.086985142s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.962952774 (126h38m45.643148343s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.988648514 (126h38m45.668844073s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.017026896 (126h38m45.697222465s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.056150074 (126h38m45.736345643s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.062962407 (126h38m45.743157976s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.101039653 (126h38m45.781235222s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.112535798 (126h38m45.792731367s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.143844376 (126h38m45.824039945s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.168296035 (126h38m45.848491604s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.196090980 (126h38m45.876286539s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.246375251 (126h38m45.92657082s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:27.065483691 (126h39m23.74567926s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:45.822355459 (126h39m42.502551018s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:104.36.82.55:4219): protocol: rpc: dial tcp 104.36.82.55:4219: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822406667 (126h39m42.502602236s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12faeDgwCPWMN4w1RxSPWwPTGNbaKnA87zYX8dhFRgm7F2YLYbV, address:104.36.82.48:4575): protocol: rpc: dial tcp 104.36.82.48:4575: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822416856 (126h39m42.502612415s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822440732 (126h39m42.502636291s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1FdJoeW4vejiQx1QkQ1nCkApgQaW6fB66d2usAYVfFuK1PPmRP, address:104.36.82.16:4317): protocol: write tcp 188.166.225.170:40168->104.36.82.16:4317: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822469587 (126h39m42.502665156s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1GEmVgDhSMyFLPY5qcc4gGqD9amUzhZ2iduyWusUSrVjLgBu1T, address:104.36.82.22:4535): protocol: rpc: dial tcp 104.36.82.22:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822492131 (126h39m42.5026877s) [seg_pos={0 0}, upload=111394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Sep 3 20:47:46.061841650 (126h39m42.742037219s) [upload=111394]: Done uploading segments... Sep 3 20:47:46.061868962 (126h39m42.742064532s) [upload=111394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.817779095s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.10220882s FAIL (2025-09-03 21:28:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ments... Sep 3 20:46:46.507740238 (126h38m43.187935807s) [upload=111394]: Got next segment. Inline: false Sep 3 20:46:46.507796726 (126h38m43.187992295s) [upload=111394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 20:46:46.507801555 (126h38m43.187997124s) [upload=111394]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 20:46:46.986921972 (126h38m43.667117531s) [seg_pos={0 0}, upload=111394]: Begin upload segment... Sep 3 20:46:46.986970355 (126h38m43.667165924s) [seg_pos={0 0}, upload=111394]: Done begin upload segment. Sep 3 20:46:46.986993188 (126h38m43.667188757s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987025891 (126h38m43.66722149s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987379036 (126h38m43.667574605s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987539673 (126h38m43.667735242s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987676215 (126h38m43.667871784s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987898590 (126h38m43.668094159s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988014642 (126h38m43.668210211s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988236147 (126h38m43.668431716s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988315938 (126h38m43.668511507s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988564003 (126h38m43.668759572s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988571097 (126h38m43.668766656s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988913612 (126h38m43.669109181s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989158771 (126h38m43.66935433s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989460519 (126h38m43.669656088s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.991957024 (126h38m43.672152593s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992228534 (126h38m43.672424103s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992436231 (126h38m43.6726318s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992636855 (126h38m43.672832424s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:48.098682631 (126h38m44.7788782s) [upload=111394]: Next returned nil segment Sep 3 20:46:48.098703030 (126h38m44.778898599s) [upload=111394]: Waiting for error group managing segments... Sep 3 20:46:48.406789573 (126h38m45.086985142s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.962952774 (126h38m45.643148343s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.988648514 (126h38m45.668844073s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.017026896 (126h38m45.697222465s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.056150074 (126h38m45.736345643s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.062962407 (126h38m45.743157976s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.101039653 (126h38m45.781235222s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.112535798 (126h38m45.792731367s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.143844376 (126h38m45.824039945s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.168296035 (126h38m45.848491604s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.196090980 (126h38m45.876286539s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.246375251 (126h38m45.92657082s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:27.065483691 (126h39m23.74567926s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:45.822355459 (126h39m42.502551018s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:104.36.82.55:4219): protocol: rpc: dial tcp 104.36.82.55:4219: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822406667 (126h39m42.502602236s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12faeDgwCPWMN4w1RxSPWwPTGNbaKnA87zYX8dhFRgm7F2YLYbV, address:104.36.82.48:4575): protocol: rpc: dial tcp 104.36.82.48:4575: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822416856 (126h39m42.502612415s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822440732 (126h39m42.502636291s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1FdJoeW4vejiQx1QkQ1nCkApgQaW6fB66d2usAYVfFuK1PPmRP, address:104.36.82.16:4317): protocol: write tcp 188.166.225.170:40168->104.36.82.16:4317: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822469587 (126h39m42.502665156s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1GEmVgDhSMyFLPY5qcc4gGqD9amUzhZ2iduyWusUSrVjLgBu1T, address:104.36.82.22:4535): protocol: rpc: dial tcp 104.36.82.22:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822492131 (126h39m42.5026877s) [seg_pos={0 0}, upload=111394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Sep 3 20:47:46.061841650 (126h39m42.742037219s) [upload=111394]: Done uploading segments... Sep 3 20:47:46.061868962 (126h39m42.742064532s) [upload=111394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.102259858s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.436175211s FAIL (2025-09-03 21:28:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ments... Sep 3 20:46:46.507740238 (126h38m43.187935807s) [upload=111394]: Got next segment. Inline: false Sep 3 20:46:46.507796726 (126h38m43.187992295s) [upload=111394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 20:46:46.507801555 (126h38m43.187997124s) [upload=111394]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 20:46:46.986921972 (126h38m43.667117531s) [seg_pos={0 0}, upload=111394]: Begin upload segment... Sep 3 20:46:46.986970355 (126h38m43.667165924s) [seg_pos={0 0}, upload=111394]: Done begin upload segment. Sep 3 20:46:46.986993188 (126h38m43.667188757s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987025891 (126h38m43.66722149s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987379036 (126h38m43.667574605s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987539673 (126h38m43.667735242s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987676215 (126h38m43.667871784s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987898590 (126h38m43.668094159s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988014642 (126h38m43.668210211s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988236147 (126h38m43.668431716s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988315938 (126h38m43.668511507s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988564003 (126h38m43.668759572s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988571097 (126h38m43.668766656s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988913612 (126h38m43.669109181s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989158771 (126h38m43.66935433s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989460519 (126h38m43.669656088s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.991957024 (126h38m43.672152593s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992228534 (126h38m43.672424103s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992436231 (126h38m43.6726318s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992636855 (126h38m43.672832424s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:48.098682631 (126h38m44.7788782s) [upload=111394]: Next returned nil segment Sep 3 20:46:48.098703030 (126h38m44.778898599s) [upload=111394]: Waiting for error group managing segments... Sep 3 20:46:48.406789573 (126h38m45.086985142s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.962952774 (126h38m45.643148343s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.988648514 (126h38m45.668844073s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.017026896 (126h38m45.697222465s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.056150074 (126h38m45.736345643s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.062962407 (126h38m45.743157976s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.101039653 (126h38m45.781235222s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.112535798 (126h38m45.792731367s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.143844376 (126h38m45.824039945s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.168296035 (126h38m45.848491604s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.196090980 (126h38m45.876286539s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.246375251 (126h38m45.92657082s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:27.065483691 (126h39m23.74567926s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:45.822355459 (126h39m42.502551018s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:104.36.82.55:4219): protocol: rpc: dial tcp 104.36.82.55:4219: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822406667 (126h39m42.502602236s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12faeDgwCPWMN4w1RxSPWwPTGNbaKnA87zYX8dhFRgm7F2YLYbV, address:104.36.82.48:4575): protocol: rpc: dial tcp 104.36.82.48:4575: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822416856 (126h39m42.502612415s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822440732 (126h39m42.502636291s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1FdJoeW4vejiQx1QkQ1nCkApgQaW6fB66d2usAYVfFuK1PPmRP, address:104.36.82.16:4317): protocol: write tcp 188.166.225.170:40168->104.36.82.16:4317: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822469587 (126h39m42.502665156s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1GEmVgDhSMyFLPY5qcc4gGqD9amUzhZ2iduyWusUSrVjLgBu1T, address:104.36.82.22:4535): protocol: rpc: dial tcp 104.36.82.22:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822492131 (126h39m42.5026877s) [seg_pos={0 0}, upload=111394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Sep 3 20:47:46.061841650 (126h39m42.742037219s) [upload=111394]: Done uploading segments... Sep 3 20:47:46.061868962 (126h39m42.742064532s) [upload=111394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.436199599s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.882795934s FAIL (2025-09-03 21:27:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ments... Sep 3 20:46:46.507740238 (126h38m43.187935807s) [upload=111394]: Got next segment. Inline: false Sep 3 20:46:46.507796726 (126h38m43.187992295s) [upload=111394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 20:46:46.507801555 (126h38m43.187997124s) [upload=111394]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 20:46:46.986921972 (126h38m43.667117531s) [seg_pos={0 0}, upload=111394]: Begin upload segment... Sep 3 20:46:46.986970355 (126h38m43.667165924s) [seg_pos={0 0}, upload=111394]: Done begin upload segment. Sep 3 20:46:46.986993188 (126h38m43.667188757s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987025891 (126h38m43.66722149s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987379036 (126h38m43.667574605s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987539673 (126h38m43.667735242s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987676215 (126h38m43.667871784s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987898590 (126h38m43.668094159s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988014642 (126h38m43.668210211s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988236147 (126h38m43.668431716s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988315938 (126h38m43.668511507s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988564003 (126h38m43.668759572s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988571097 (126h38m43.668766656s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988913612 (126h38m43.669109181s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989158771 (126h38m43.66935433s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989460519 (126h38m43.669656088s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.991957024 (126h38m43.672152593s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992228534 (126h38m43.672424103s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992436231 (126h38m43.6726318s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992636855 (126h38m43.672832424s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:48.098682631 (126h38m44.7788782s) [upload=111394]: Next returned nil segment Sep 3 20:46:48.098703030 (126h38m44.778898599s) [upload=111394]: Waiting for error group managing segments... Sep 3 20:46:48.406789573 (126h38m45.086985142s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.962952774 (126h38m45.643148343s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.988648514 (126h38m45.668844073s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.017026896 (126h38m45.697222465s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.056150074 (126h38m45.736345643s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.062962407 (126h38m45.743157976s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.101039653 (126h38m45.781235222s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.112535798 (126h38m45.792731367s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.143844376 (126h38m45.824039945s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.168296035 (126h38m45.848491604s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.196090980 (126h38m45.876286539s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.246375251 (126h38m45.92657082s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:27.065483691 (126h39m23.74567926s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:45.822355459 (126h39m42.502551018s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:104.36.82.55:4219): protocol: rpc: dial tcp 104.36.82.55:4219: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822406667 (126h39m42.502602236s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12faeDgwCPWMN4w1RxSPWwPTGNbaKnA87zYX8dhFRgm7F2YLYbV, address:104.36.82.48:4575): protocol: rpc: dial tcp 104.36.82.48:4575: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822416856 (126h39m42.502612415s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822440732 (126h39m42.502636291s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1FdJoeW4vejiQx1QkQ1nCkApgQaW6fB66d2usAYVfFuK1PPmRP, address:104.36.82.16:4317): protocol: write tcp 188.166.225.170:40168->104.36.82.16:4317: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822469587 (126h39m42.502665156s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1GEmVgDhSMyFLPY5qcc4gGqD9amUzhZ2iduyWusUSrVjLgBu1T, address:104.36.82.22:4535): protocol: rpc: dial tcp 104.36.82.22:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822492131 (126h39m42.5026877s) [seg_pos={0 0}, upload=111394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Sep 3 20:47:46.061841650 (126h39m42.742037219s) [upload=111394]: Done uploading segments... Sep 3 20:47:46.061868962 (126h39m42.742064532s) [upload=111394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.882824851s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.028269817s FAIL (2025-09-03 21:26:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ments... Sep 3 20:46:46.507740238 (126h38m43.187935807s) [upload=111394]: Got next segment. Inline: false Sep 3 20:46:46.507796726 (126h38m43.187992295s) [upload=111394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 20:46:46.507801555 (126h38m43.187997124s) [upload=111394]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 20:46:46.986921972 (126h38m43.667117531s) [seg_pos={0 0}, upload=111394]: Begin upload segment... Sep 3 20:46:46.986970355 (126h38m43.667165924s) [seg_pos={0 0}, upload=111394]: Done begin upload segment. Sep 3 20:46:46.986993188 (126h38m43.667188757s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987025891 (126h38m43.66722149s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987379036 (126h38m43.667574605s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987539673 (126h38m43.667735242s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987676215 (126h38m43.667871784s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987898590 (126h38m43.668094159s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988014642 (126h38m43.668210211s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988236147 (126h38m43.668431716s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988315938 (126h38m43.668511507s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988564003 (126h38m43.668759572s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988571097 (126h38m43.668766656s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988913612 (126h38m43.669109181s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989158771 (126h38m43.66935433s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989460519 (126h38m43.669656088s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.991957024 (126h38m43.672152593s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992228534 (126h38m43.672424103s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992436231 (126h38m43.6726318s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992636855 (126h38m43.672832424s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:48.098682631 (126h38m44.7788782s) [upload=111394]: Next returned nil segment Sep 3 20:46:48.098703030 (126h38m44.778898599s) [upload=111394]: Waiting for error group managing segments... Sep 3 20:46:48.406789573 (126h38m45.086985142s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.962952774 (126h38m45.643148343s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.988648514 (126h38m45.668844073s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.017026896 (126h38m45.697222465s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.056150074 (126h38m45.736345643s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.062962407 (126h38m45.743157976s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.101039653 (126h38m45.781235222s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.112535798 (126h38m45.792731367s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.143844376 (126h38m45.824039945s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.168296035 (126h38m45.848491604s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.196090980 (126h38m45.876286539s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.246375251 (126h38m45.92657082s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:27.065483691 (126h39m23.74567926s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:45.822355459 (126h39m42.502551018s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:104.36.82.55:4219): protocol: rpc: dial tcp 104.36.82.55:4219: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822406667 (126h39m42.502602236s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12faeDgwCPWMN4w1RxSPWwPTGNbaKnA87zYX8dhFRgm7F2YLYbV, address:104.36.82.48:4575): protocol: rpc: dial tcp 104.36.82.48:4575: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822416856 (126h39m42.502612415s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822440732 (126h39m42.502636291s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1FdJoeW4vejiQx1QkQ1nCkApgQaW6fB66d2usAYVfFuK1PPmRP, address:104.36.82.16:4317): protocol: write tcp 188.166.225.170:40168->104.36.82.16:4317: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822469587 (126h39m42.502665156s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1GEmVgDhSMyFLPY5qcc4gGqD9amUzhZ2iduyWusUSrVjLgBu1T, address:104.36.82.22:4535): protocol: rpc: dial tcp 104.36.82.22:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822492131 (126h39m42.5026877s) [seg_pos={0 0}, upload=111394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Sep 3 20:47:46.061841650 (126h39m42.742037219s) [upload=111394]: Done uploading segments... Sep 3 20:47:46.061868962 (126h39m42.742064532s) [upload=111394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.028296739s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.104223611s FAIL (2025-09-03 21:26:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ments... Sep 3 20:46:46.507740238 (126h38m43.187935807s) [upload=111394]: Got next segment. Inline: false Sep 3 20:46:46.507796726 (126h38m43.187992295s) [upload=111394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 20:46:46.507801555 (126h38m43.187997124s) [upload=111394]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 20:46:46.986921972 (126h38m43.667117531s) [seg_pos={0 0}, upload=111394]: Begin upload segment... Sep 3 20:46:46.986970355 (126h38m43.667165924s) [seg_pos={0 0}, upload=111394]: Done begin upload segment. Sep 3 20:46:46.986993188 (126h38m43.667188757s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987025891 (126h38m43.66722149s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987379036 (126h38m43.667574605s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987539673 (126h38m43.667735242s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987676215 (126h38m43.667871784s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987898590 (126h38m43.668094159s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988014642 (126h38m43.668210211s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988236147 (126h38m43.668431716s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988315938 (126h38m43.668511507s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988564003 (126h38m43.668759572s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988571097 (126h38m43.668766656s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988913612 (126h38m43.669109181s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989158771 (126h38m43.66935433s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989460519 (126h38m43.669656088s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.991957024 (126h38m43.672152593s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992228534 (126h38m43.672424103s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992436231 (126h38m43.6726318s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992636855 (126h38m43.672832424s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:48.098682631 (126h38m44.7788782s) [upload=111394]: Next returned nil segment Sep 3 20:46:48.098703030 (126h38m44.778898599s) [upload=111394]: Waiting for error group managing segments... Sep 3 20:46:48.406789573 (126h38m45.086985142s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.962952774 (126h38m45.643148343s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.988648514 (126h38m45.668844073s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.017026896 (126h38m45.697222465s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.056150074 (126h38m45.736345643s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.062962407 (126h38m45.743157976s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.101039653 (126h38m45.781235222s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.112535798 (126h38m45.792731367s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.143844376 (126h38m45.824039945s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.168296035 (126h38m45.848491604s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.196090980 (126h38m45.876286539s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.246375251 (126h38m45.92657082s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:27.065483691 (126h39m23.74567926s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:45.822355459 (126h39m42.502551018s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:104.36.82.55:4219): protocol: rpc: dial tcp 104.36.82.55:4219: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822406667 (126h39m42.502602236s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12faeDgwCPWMN4w1RxSPWwPTGNbaKnA87zYX8dhFRgm7F2YLYbV, address:104.36.82.48:4575): protocol: rpc: dial tcp 104.36.82.48:4575: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822416856 (126h39m42.502612415s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822440732 (126h39m42.502636291s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1FdJoeW4vejiQx1QkQ1nCkApgQaW6fB66d2usAYVfFuK1PPmRP, address:104.36.82.16:4317): protocol: write tcp 188.166.225.170:40168->104.36.82.16:4317: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822469587 (126h39m42.502665156s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1GEmVgDhSMyFLPY5qcc4gGqD9amUzhZ2iduyWusUSrVjLgBu1T, address:104.36.82.22:4535): protocol: rpc: dial tcp 104.36.82.22:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822492131 (126h39m42.5026877s) [seg_pos={0 0}, upload=111394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Sep 3 20:47:46.061841650 (126h39m42.742037219s) [upload=111394]: Done uploading segments... Sep 3 20:47:46.061868962 (126h39m42.742064532s) [upload=111394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.104269739s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.016250023s FAIL (2025-09-03 21:25:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ments... Sep 3 20:46:46.507740238 (126h38m43.187935807s) [upload=111394]: Got next segment. Inline: false Sep 3 20:46:46.507796726 (126h38m43.187992295s) [upload=111394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 20:46:46.507801555 (126h38m43.187997124s) [upload=111394]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 20:46:46.986921972 (126h38m43.667117531s) [seg_pos={0 0}, upload=111394]: Begin upload segment... Sep 3 20:46:46.986970355 (126h38m43.667165924s) [seg_pos={0 0}, upload=111394]: Done begin upload segment. Sep 3 20:46:46.986993188 (126h38m43.667188757s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987025891 (126h38m43.66722149s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987379036 (126h38m43.667574605s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987539673 (126h38m43.667735242s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987676215 (126h38m43.667871784s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987898590 (126h38m43.668094159s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988014642 (126h38m43.668210211s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988236147 (126h38m43.668431716s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988315938 (126h38m43.668511507s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988564003 (126h38m43.668759572s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988571097 (126h38m43.668766656s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988913612 (126h38m43.669109181s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989158771 (126h38m43.66935433s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989460519 (126h38m43.669656088s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.991957024 (126h38m43.672152593s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992228534 (126h38m43.672424103s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992436231 (126h38m43.6726318s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992636855 (126h38m43.672832424s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:48.098682631 (126h38m44.7788782s) [upload=111394]: Next returned nil segment Sep 3 20:46:48.098703030 (126h38m44.778898599s) [upload=111394]: Waiting for error group managing segments... Sep 3 20:46:48.406789573 (126h38m45.086985142s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.962952774 (126h38m45.643148343s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.988648514 (126h38m45.668844073s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.017026896 (126h38m45.697222465s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.056150074 (126h38m45.736345643s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.062962407 (126h38m45.743157976s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.101039653 (126h38m45.781235222s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.112535798 (126h38m45.792731367s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.143844376 (126h38m45.824039945s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.168296035 (126h38m45.848491604s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.196090980 (126h38m45.876286539s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.246375251 (126h38m45.92657082s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:27.065483691 (126h39m23.74567926s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:45.822355459 (126h39m42.502551018s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:104.36.82.55:4219): protocol: rpc: dial tcp 104.36.82.55:4219: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822406667 (126h39m42.502602236s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12faeDgwCPWMN4w1RxSPWwPTGNbaKnA87zYX8dhFRgm7F2YLYbV, address:104.36.82.48:4575): protocol: rpc: dial tcp 104.36.82.48:4575: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822416856 (126h39m42.502612415s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822440732 (126h39m42.502636291s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1FdJoeW4vejiQx1QkQ1nCkApgQaW6fB66d2usAYVfFuK1PPmRP, address:104.36.82.16:4317): protocol: write tcp 188.166.225.170:40168->104.36.82.16:4317: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822469587 (126h39m42.502665156s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1GEmVgDhSMyFLPY5qcc4gGqD9amUzhZ2iduyWusUSrVjLgBu1T, address:104.36.82.22:4535): protocol: rpc: dial tcp 104.36.82.22:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822492131 (126h39m42.5026877s) [seg_pos={0 0}, upload=111394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Sep 3 20:47:46.061841650 (126h39m42.742037219s) [upload=111394]: Done uploading segments... Sep 3 20:47:46.061868962 (126h39m42.742064532s) [upload=111394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.016284289s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.302641958s FAIL (2025-09-03 21:25:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ments... Sep 3 20:46:46.507740238 (126h38m43.187935807s) [upload=111394]: Got next segment. Inline: false Sep 3 20:46:46.507796726 (126h38m43.187992295s) [upload=111394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 20:46:46.507801555 (126h38m43.187997124s) [upload=111394]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 20:46:46.986921972 (126h38m43.667117531s) [seg_pos={0 0}, upload=111394]: Begin upload segment... Sep 3 20:46:46.986970355 (126h38m43.667165924s) [seg_pos={0 0}, upload=111394]: Done begin upload segment. Sep 3 20:46:46.986993188 (126h38m43.667188757s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987025891 (126h38m43.66722149s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987379036 (126h38m43.667574605s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987539673 (126h38m43.667735242s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987676215 (126h38m43.667871784s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987898590 (126h38m43.668094159s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988014642 (126h38m43.668210211s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988236147 (126h38m43.668431716s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988315938 (126h38m43.668511507s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988564003 (126h38m43.668759572s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988571097 (126h38m43.668766656s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988913612 (126h38m43.669109181s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989158771 (126h38m43.66935433s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989460519 (126h38m43.669656088s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.991957024 (126h38m43.672152593s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992228534 (126h38m43.672424103s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992436231 (126h38m43.6726318s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992636855 (126h38m43.672832424s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:48.098682631 (126h38m44.7788782s) [upload=111394]: Next returned nil segment Sep 3 20:46:48.098703030 (126h38m44.778898599s) [upload=111394]: Waiting for error group managing segments... Sep 3 20:46:48.406789573 (126h38m45.086985142s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.962952774 (126h38m45.643148343s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.988648514 (126h38m45.668844073s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.017026896 (126h38m45.697222465s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.056150074 (126h38m45.736345643s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.062962407 (126h38m45.743157976s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.101039653 (126h38m45.781235222s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.112535798 (126h38m45.792731367s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.143844376 (126h38m45.824039945s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.168296035 (126h38m45.848491604s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.196090980 (126h38m45.876286539s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.246375251 (126h38m45.92657082s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:27.065483691 (126h39m23.74567926s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:45.822355459 (126h39m42.502551018s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:104.36.82.55:4219): protocol: rpc: dial tcp 104.36.82.55:4219: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822406667 (126h39m42.502602236s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12faeDgwCPWMN4w1RxSPWwPTGNbaKnA87zYX8dhFRgm7F2YLYbV, address:104.36.82.48:4575): protocol: rpc: dial tcp 104.36.82.48:4575: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822416856 (126h39m42.502612415s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822440732 (126h39m42.502636291s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1FdJoeW4vejiQx1QkQ1nCkApgQaW6fB66d2usAYVfFuK1PPmRP, address:104.36.82.16:4317): protocol: write tcp 188.166.225.170:40168->104.36.82.16:4317: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822469587 (126h39m42.502665156s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1GEmVgDhSMyFLPY5qcc4gGqD9amUzhZ2iduyWusUSrVjLgBu1T, address:104.36.82.22:4535): protocol: rpc: dial tcp 104.36.82.22:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822492131 (126h39m42.5026877s) [seg_pos={0 0}, upload=111394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Sep 3 20:47:46.061841650 (126h39m42.742037219s) [upload=111394]: Done uploading segments... Sep 3 20:47:46.061868962 (126h39m42.742064532s) [upload=111394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.302671132s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.11240095s FAIL (2025-09-03 21:24:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== ments... Sep 3 20:46:46.507740238 (126h38m43.187935807s) [upload=111394]: Got next segment. Inline: false Sep 3 20:46:46.507796726 (126h38m43.187992295s) [upload=111394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 20:46:46.507801555 (126h38m43.187997124s) [upload=111394]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 20:46:46.986921972 (126h38m43.667117531s) [seg_pos={0 0}, upload=111394]: Begin upload segment... Sep 3 20:46:46.986970355 (126h38m43.667165924s) [seg_pos={0 0}, upload=111394]: Done begin upload segment. Sep 3 20:46:46.986993188 (126h38m43.667188757s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987025891 (126h38m43.66722149s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987379036 (126h38m43.667574605s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987539673 (126h38m43.667735242s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987676215 (126h38m43.667871784s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.987898590 (126h38m43.668094159s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988014642 (126h38m43.668210211s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988236147 (126h38m43.668431716s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988315938 (126h38m43.668511507s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988564003 (126h38m43.668759572s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988571097 (126h38m43.668766656s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.988913612 (126h38m43.669109181s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989158771 (126h38m43.66935433s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.989460519 (126h38m43.669656088s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.991957024 (126h38m43.672152593s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992228534 (126h38m43.672424103s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992436231 (126h38m43.6726318s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:46.992636855 (126h38m43.672832424s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Uploading piece... Sep 3 20:46:48.098682631 (126h38m44.7788782s) [upload=111394]: Next returned nil segment Sep 3 20:46:48.098703030 (126h38m44.778898599s) [upload=111394]: Waiting for error group managing segments... Sep 3 20:46:48.406789573 (126h38m45.086985142s) [noise=true , address=79.127.205.246:4281 , piece_id=QXRDTCL7H3ITI2PLSJJJEAGROZPWN2KIJ444CEEYWSB3UCUFY2CA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.962952774 (126h38m45.643148343s) [noise=true , address=45.91.116.4:4970 , piece_id=C4YUTP5ZEMC3USHH4XI7GPJJURCLJAAVAKCER23PTHJLDSIZBS7Q, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:48.988648514 (126h38m45.668844073s) [noise=true , address=104.36.82.23:4448 , piece_id=JCAW7N3GD2LB3GLG2KKN2JWZAINHIANELCROC323AYT5IDOMJ2QA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.017026896 (126h38m45.697222465s) [noise=true , address=104.36.82.45:4913 , piece_id=5OBS7EYG55VCOVM6P6EEBURFH5ZVZAITTJDXVZQ6MGWFZY3BJJGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.056150074 (126h38m45.736345643s) [noise=true , address=79.127.219.51:4211 , piece_id=V5ND57HMGLOWTZJNQQENID6F3XIPSIVGIPEFCA6KWB5PO74O3CSQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.062962407 (126h38m45.743157976s) [noise=true , address=79.127.219.48:4097 , piece_id=XRKV2TH5LHLFN4IGXDCL6SXUSX6VXYASY3DEZEKFXPY423YLL7GA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.101039653 (126h38m45.781235222s) [noise=true , address=104.36.82.62:4424 , piece_id=ZXON73WOTJTRXYGPQ72ZSBYKV6IX3Y6XHR57WNQITL6NDQRMD7PA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.112535798 (126h38m45.792731367s) [noise=true , address=104.36.82.61:4394 , piece_id=USAY7CLHU4ROASDJP4WZIEMNI3XPYLXCWFJFMA4D6J6WWFH7FJNA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.143844376 (126h38m45.824039945s) [noise=true , address=104.36.82.60:4369 , piece_id=QXZT7U2HPQYCC4ZCPOQBHVQ7DRHAAWYCT62B2NSLLVXF6QYNNYFQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.168296035 (126h38m45.848491604s) [noise=true , address=104.36.82.12:4181 , piece_id=QXN6FDROBKFVJ3QWB2AWODIUYXUSR7SOT6C3G54MKKBGABEO5HGQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.196090980 (126h38m45.876286539s) [noise=true , address=77.90.31.13:4640 , piece_id=VHPOQGP2ARQG7W35FGAN4IZ67TPOAN3ZZKYQRBGDTXMTE2ONEWDQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:46:49.246375251 (126h38m45.92657082s) [noise=true , address=45.91.116.13:4183 , piece_id=LD3UOZIJCXHI62LLMYNVKUMVHY2FW2BRQSRKPCYBGBP2D4OPLVJQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:27.065483691 (126h39m23.74567926s) [noise=true , address=77.90.31.10:4534 , piece_id=ZX65LITWYP7ZTZIX6OCEIBUXADDOYLBGDMHJFDL7H3MUXSOB5C4A, seg_pos={0 0}, upload=111394]: Done uploading piece. err: <nil> Sep 3 20:47:45.822355459 (126h39m42.502551018s) [noise=true , address=104.36.82.55:4219 , piece_id=M2WZIGKDJLZSRXM7GKREZW5OIXIZDS7CDP2E4LEZXTAF2NA77UEA, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12TqSxiG3LYYc3W5T6wqiuuKwoh1LvCdntou7ve6TAEbXYf2QKn, address:104.36.82.55:4219): protocol: rpc: dial tcp 104.36.82.55:4219: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822406667 (126h39m42.502602236s) [noise=true , address=104.36.82.48:4575 , piece_id=HRJYB65CBIDK6LXON2NGWQ74CCAQVGZFP3JFR4S3SHMFNZT7RYUQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12faeDgwCPWMN4w1RxSPWwPTGNbaKnA87zYX8dhFRgm7F2YLYbV, address:104.36.82.48:4575): protocol: rpc: dial tcp 104.36.82.48:4575: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822416856 (126h39m42.502612415s) [noise=true , address=104.36.82.51:4072 , piece_id=FPBULLBNWI52THBKU6DAM7JUIIABW3REFC63ZNV6LHJNFIFHERBQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:12FSQUJNBPY52p2Wkg48DWPN3bdciabNacXcgDEHSwLRrnPG9ne, address:104.36.82.51:4072): protocol: rpc: dial tcp 104.36.82.51:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822440732 (126h39m42.502636291s) [noise=true , address=104.36.82.16:4317 , piece_id=NDEFGBA6JNXUSUTZ3INIHATNYFILQBUVAEEXPNXGKT3JPFUQXZRQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1FdJoeW4vejiQx1QkQ1nCkApgQaW6fB66d2usAYVfFuK1PPmRP, address:104.36.82.16:4317): protocol: write tcp 188.166.225.170:40168->104.36.82.16:4317: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822469587 (126h39m42.502665156s) [noise=true , address=104.36.82.22:4535 , piece_id=W2TV53W3J6PGT223LTNGCK7F77G723JD7257EQZHXANVC2PJ5XZQ, seg_pos={0 0}, upload=111394]: Done uploading piece. err: ecclient: upload failed (node:1GEmVgDhSMyFLPY5qcc4gGqD9amUzhZ2iduyWusUSrVjLgBu1T, address:104.36.82.22:4535): protocol: rpc: dial tcp 104.36.82.22:4535: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 3 20:47:45.822492131 (126h39m42.5026877s) [seg_pos={0 0}, upload=111394]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Sep 3 20:47:46.061841650 (126h39m42.742037219s) [upload=111394]: Done uploading segments... Sep 3 20:47:46.061868962 (126h39m42.742064532s) [upload=111394]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.112425267s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)