Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.695392443s FAIL (2025-09-09 14:13:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.695424967s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [X..........X............................XXXXXXX...XXXXXXXXXX] duration: 30.00251523s FAIL (2025-09-09 14:13:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:12:42.425660060 (72h44m18.46523317s) [upload=64019]: Starting upload Sep 9 14:12:42.425726937 (72h44m18.465300058s) [upload=64019]: Done starting upload Sep 9 14:12:42.425872596 (72h44m18.465445716s) [upload=64019]: Uploading segments... Sep 9 14:12:42.426060756 (72h44m18.465633876s) [upload=64019]: Got next segment. Inline: false Sep 9 14:12:42.426118156 (72h44m18.465691266s) [upload=64019]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:12:42.426127364 (72h44m18.465700484s) [upload=64019]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:12:42.697579566 (72h44m18.737152686s) [seg_pos={0 0}, upload=64019]: Begin upload segment... Sep 9 14:12:42.697620995 (72h44m18.737194115s) [seg_pos={0 0}, upload=64019]: Done begin upload segment. Sep 9 14:12:42.697641444 (72h44m18.737214564s) [noise=true , address=145.79.227.7:4293 , piece_id=IISBEWFQ6XXJ4M6LABXYQFGEO22MKMPENLPCGHFCFZA47DSB4LYQ, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.697697812 (72h44m18.737270932s) [noise=true , address=45.91.116.8:4047 , piece_id=O4W5NQJ2LUAIA5FNR7YQKQEBQZNYGYJU6BDR55NDWM4QRPJHGEJA, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.698096876 (72h44m18.737669996s) [noise=true , address=77.90.31.14:4661 , piece_id=IQ5XZ5MYGPZQP7OVHERHNBNEBRDUKJXKGODPFFEYIBXTGFK2UFXQ, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.698371582 (72h44m18.737944702s) [noise=true , address=45.91.116.14:4191 , piece_id=RI3NWXFQYXRXAZ7RYY3L72LP3UV6MRYFJR5WBSCQHD66UFQMEMKA, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.698385227 (72h44m18.737958347s) [noise=true , address=77.90.31.12:4592 , piece_id=BX6IVSDECYAWOKTNNC4Y2WBHCFAOAMP7ZU5CVNCY55D2THL4CSLA, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.698675233 (72h44m18.738248353s) [noise=true , address=77.90.31.18:4807 , piece_id=WXHLFYFJHVZL237T6UKGU2WBN5FIJVX33YWQJLACDRSJBZX6D2JA, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.698831672 (72h44m18.738404802s) [noise=true , address=145.79.227.15:4873 , piece_id=GDOUA3MK6IXFEXMTA55J4VOV6JBANMORGW4DJ6YGZX4PSU3GYXHQ, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.698946211 (72h44m18.738519331s) [noise=true , address=45.91.116.4:4939 , piece_id=AIHPIMZROFYEVDXYAO6WWRRVYREIVWYUE33TKMNJQ3XVMBRR75QQ, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.699200608 (72h44m18.738773728s) [noise=true , address=77.90.31.13:4626 , piece_id=4RI3CNYFANPTJGAN3RPERZ7IORTOVAXH3Q7Y4CDXAIGHBW3H5CSA, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.699249020 (72h44m18.738822151s) [noise=true , address=77.90.31.19:4842 , piece_id=EOQPV3ENPLRT2QZGM3YGWKG74FZMPGIVCNUXG6O5TMV6ZY6GL5DA, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.699578781 (72h44m18.739151901s) [noise=true , address=45.91.116.12:4225 , piece_id=MRWW2WLSUSFYUG64RPNMKSGHZ6PSEHTSETLWHIYPLJ7O7OI4MWHQ, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.699789485 (72h44m18.739362605s) [noise=true , address=45.91.116.6:4975 , piece_id=QE2PD2H2LQEHC3TWNJ2JSKJW2ZPCTPA6UKIIBXTQPRGK6BBCCPIA, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.699983516 (72h44m18.739556636s) [noise=true , address=145.79.227.11:4730 , piece_id=GRKV3OH7GCDXZRYSSUWO2U5BMYRX6IDHKAAXIHNJOI6AWT6HPIOQ, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.700022420 (72h44m18.73959554s) [noise=true , address=45.91.116.10:4083 , piece_id=ENBPVJ2XNA4PNORU6DDUGOBKP6VLBZDDAQSACNRAEBBACBNAGYVA, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.700182807 (72h44m18.739755927s) [noise=true , address=77.90.31.19:4841 , piece_id=7R7PYP2RKWKVEVHBGETWBLIUI2LFJKWVTLRX3ODHNXAAQM27TNWQ, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:42.700587271 (72h44m18.740160391s) [noise=true , address=45.91.116.11:4118 , piece_id=6XBCKU22TE3FR2B6CCUANV4KNFNQXB3C7CUSYM353LUQXUU5LW7A, seg_pos={0 0}, upload=64019]: Uploading piece... Sep 9 14:12:44.541444323 (72h44m20.581017444s) [upload=64019]: Next returned nil segment Sep 9 14:12:44.541505019 (72h44m20.581078139s) [upload=64019]: Waiting for error group managing segments... Sep 9 14:12:44.836312274 (72h44m20.875885394s) [noise=true , address=145.79.227.11:4730 , piece_id=GRKV3OH7GCDXZRYSSUWO2U5BMYRX6IDHKAAXIHNJOI6AWT6HPIOQ, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:44.880954482 (72h44m20.920527602s) [noise=true , address=77.90.31.14:4661 , piece_id=IQ5XZ5MYGPZQP7OVHERHNBNEBRDUKJXKGODPFFEYIBXTGFK2UFXQ, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:44.926663510 (72h44m20.96623674s) [noise=true , address=45.91.116.6:4975 , piece_id=QE2PD2H2LQEHC3TWNJ2JSKJW2ZPCTPA6UKIIBXTQPRGK6BBCCPIA, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:44.934613414 (72h44m20.974186534s) [noise=true , address=45.91.116.4:4939 , piece_id=AIHPIMZROFYEVDXYAO6WWRRVYREIVWYUE33TKMNJQ3XVMBRR75QQ, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:44.935213482 (72h44m20.974786612s) [noise=true , address=45.91.116.12:4225 , piece_id=MRWW2WLSUSFYUG64RPNMKSGHZ6PSEHTSETLWHIYPLJ7O7OI4MWHQ, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:44.943706173 (72h44m20.983279293s) [noise=true , address=77.90.31.13:4626 , piece_id=4RI3CNYFANPTJGAN3RPERZ7IORTOVAXH3Q7Y4CDXAIGHBW3H5CSA, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:44.951462256 (72h44m20.991035386s) [noise=true , address=45.91.116.8:4047 , piece_id=O4W5NQJ2LUAIA5FNR7YQKQEBQZNYGYJU6BDR55NDWM4QRPJHGEJA, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:44.958444417 (72h44m20.998017537s) [noise=true , address=45.91.116.14:4191 , piece_id=RI3NWXFQYXRXAZ7RYY3L72LP3UV6MRYFJR5WBSCQHD66UFQMEMKA, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:45.010447941 (72h44m21.050021061s) [noise=true , address=77.90.31.19:4841 , piece_id=7R7PYP2RKWKVEVHBGETWBLIUI2LFJKWVTLRX3ODHNXAAQM27TNWQ, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:45.035209665 (72h44m21.074782785s) [noise=true , address=77.90.31.18:4807 , piece_id=WXHLFYFJHVZL237T6UKGU2WBN5FIJVX33YWQJLACDRSJBZX6D2JA, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:45.077579614 (72h44m21.117152734s) [noise=true , address=45.91.116.11:4118 , piece_id=6XBCKU22TE3FR2B6CCUANV4KNFNQXB3C7CUSYM353LUQXUU5LW7A, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:45.103514123 (72h44m21.143087243s) [noise=true , address=77.90.31.12:4592 , piece_id=BX6IVSDECYAWOKTNNC4Y2WBHCFAOAMP7ZU5CVNCY55D2THL4CSLA, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:45.668345917 (72h44m21.707919037s) [noise=true , address=145.79.227.7:4293 , piece_id=IISBEWFQ6XXJ4M6LABXYQFGEO22MKMPENLPCGHFCFZA47DSB4LYQ, seg_pos={0 0}, upload=64019]: Done uploading piece. err: <nil> Sep 9 14:12:45.668368801 (72h44m21.707941921s) [seg_pos={0 0}, upload=64019]: Segment reached optimal threshold of 13 pieces. Sep 9 14:12:45.668471407 (72h44m21.708044527s) [noise=true , address=77.90.31.19:4842 , piece_id=EOQPV3ENPLRT2QZGM3YGWKG74FZMPGIVCNUXG6O5TMV6ZY6GL5DA, seg_pos={0 0}, upload=64019]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF Sep 9 14:12:45.668527014 (72h44m21.708100134s) [noise=true , address=45.91.116.10:4083 , piece_id=ENBPVJ2XNA4PNORU6DDUGOBKP6VLBZDDAQSACNRAEBBACBNAGYVA, seg_pos={0 0}, upload=64019]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B): protocol: expected piece hash; context canceled; EOF Sep 9 14:12:45.668598871 (72h44m21.708171991s) [noise=true , address=145.79.227.15:4873 , piece_id=GDOUA3MK6IXFEXMTA55J4VOV6JBANMORGW4DJ6YGZX4PSU3GYXHQ, seg_pos={0 0}, upload=64019]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3): protocol: write tcp 188.166.225.170:59264->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:59264->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59264->145.79.227.15:4873: use of closed network connection Sep 9 14:12:45.668623388 (72h44m21.708196498s) [seg_pos={0 0}, upload=64019]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:12:45.668712168 (72h44m21.708285288s) [upload=64019]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:12:45.668719672 (72h44m21.708292812s) [upload=64019]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:12:45.998888033 (72h44m22.038461153s) [upload=64019]: Done uploading segments... Sep 9 14:12:45.998911138 (72h44m22.038484268s) [upload=64019]: Upload finished. err: <nil> Duration: 30.002541541s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.407208743s FAIL (2025-09-09 14:12:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.407229333s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.693959959s FAIL (2025-09-09 14:12:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.693984766s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [.X..........X............................XXXXXXX...XXXXXXXXX] duration: 30.001569975s FAIL (2025-09-09 14:12:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:11:45.611307914 (72h43m21.650881035s) [upload=64004]: Starting upload Sep 9 14:11:45.611358471 (72h43m21.650931591s) [upload=64004]: Done starting upload Sep 9 14:11:45.611452371 (72h43m21.651025491s) [upload=64004]: Uploading segments... Sep 9 14:11:45.611548725 (72h43m21.651121845s) [upload=64004]: Got next segment. Inline: false Sep 9 14:11:45.611580887 (72h43m21.651154007s) [upload=64004]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:11:45.611585656 (72h43m21.651158776s) [upload=64004]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:11:45.877467779 (72h43m21.917040899s) [seg_pos={0 0}, upload=64004]: Begin upload segment... Sep 9 14:11:45.877515049 (72h43m21.917088159s) [seg_pos={0 0}, upload=64004]: Done begin upload segment. Sep 9 14:11:45.877529226 (72h43m21.917102346s) [noise=true , address=45.91.116.6:4975 , piece_id=ZWBQZZD6F4X6WZVRENP3V67WSWBPERCZCYTUH7KVXF5S4C2LKJYA, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.877536530 (72h43m21.91710965s) [noise=true , address=77.90.31.17:4772 , piece_id=UMVQQBDM6JDEZR4GAR4OFBXAFU65QMC4K6YGKHP3UFOTBPKCCXUA, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.877619128 (72h43m21.917192238s) [noise=true , address=45.91.116.4:4937 , piece_id=UPQLY2N4WSONHRK2Q3T3ZAI5KXYWKH57M53B6M35SBBIF4VR7YQQ, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.878000999 (72h43m21.917574119s) [noise=true , address=145.79.227.4:4186 , piece_id=HRE2CHJKJQVQH3M67CWDIKHGLMO63SFF2RMG3PH26XSRH7KNPE3A, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.878039273 (72h43m21.917612403s) [noise=true , address=77.90.31.12:4589 , piece_id=PHAZDQXXG2UQMIT2CBEI2GMZYRKFS7TRQBKPZBUOX7R4V4VNKQEQ, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.878311143 (72h43m21.917884263s) [noise=true , address=77.90.31.15:4698 , piece_id=FDDREIRFYA5LM52EOZ2OFMEKXW4B6UPNNZALIXN3MCOLN4CW6XXQ, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.878621937 (72h43m21.918195057s) [noise=true , address=145.79.227.2:4115 , piece_id=WZYQH5JMVVRNIXYVTAH5F4W5LYPPLGYX2IICFMN6NURUDSJA4QIQ, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.878972328 (72h43m21.918545448s) [noise=true , address=45.91.116.7:4011 , piece_id=JYWYXCJNYENUDIRS2MA77XA2MS4ZAICPK6NP2KDHJP6HWBM23SWA, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.879302880 (72h43m21.918876s) [noise=true , address=77.90.31.21:4879 , piece_id=XQGOUODVJQ5WJ5ENMRE4SKXJFTG5PDOYI4Q7TBSXCZQVR7QPA2GQ, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.879560112 (72h43m21.919133232s) [noise=true , address=77.90.31.21:4878 , piece_id=U3XWVYPZTZIXER76BOFPA2H6ZM2Y55FF5YJKGJRO2H4ERJBYGCYQ, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.879803368 (72h43m21.919376488s) [noise=true , address=45.91.116.14:4189 , piece_id=NNPPMVE2Y5T43P3YLSFN7VWDRFKY2VWEH2H4SIYHJYQYZTSAM7YA, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.880061783 (72h43m21.919634903s) [noise=true , address=45.91.116.5:4297 , piece_id=PQRVZL5LQN3MSWBSOL2UJZEAHDKLMSPC4RTNJE2K4ULQ2UIPI7TA, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.880350274 (72h43m21.919923384s) [noise=true , address=145.79.227.11:4729 , piece_id=IURULFMZHYHLEBQTOVJ3PS4MCKHSAHM3WPVVWWD5QC5OUD7IOORQ, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.880606014 (72h43m21.920179134s) [noise=true , address=45.91.116.12:4227 , piece_id=TB2XO27UXN6UCLKNBS62IA7C5RRMTA7QED4ANLLYOLHFYM4C4S2Q, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.880685767 (72h43m21.920258887s) [noise=true , address=45.91.116.9:4262 , piece_id=XFHBBEHJCNLJ3SEQFG3VGLIPEEM5EISQ3IHOEIF6IFRPKN72DPCQ, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:45.880920716 (72h43m21.920493836s) [noise=true , address=145.79.227.5:4223 , piece_id=2JJQWMJVQMGTTQOWIZRSB6NWLXSKMX33NL53CFSDZ7K5NYT737DQ, seg_pos={0 0}, upload=64004]: Uploading piece... Sep 9 14:11:47.696654141 (72h43m23.736227271s) [upload=64004]: Next returned nil segment Sep 9 14:11:47.696671915 (72h43m23.736245035s) [upload=64004]: Waiting for error group managing segments... Sep 9 14:11:48.029456563 (72h43m24.069029683s) [noise=true , address=145.79.227.5:4223 , piece_id=2JJQWMJVQMGTTQOWIZRSB6NWLXSKMX33NL53CFSDZ7K5NYT737DQ, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.070238774 (72h43m24.109811904s) [noise=true , address=45.91.116.12:4227 , piece_id=TB2XO27UXN6UCLKNBS62IA7C5RRMTA7QED4ANLLYOLHFYM4C4S2Q, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.092290762 (72h43m24.131863882s) [noise=true , address=77.90.31.12:4589 , piece_id=PHAZDQXXG2UQMIT2CBEI2GMZYRKFS7TRQBKPZBUOX7R4V4VNKQEQ, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.108361556 (72h43m24.147934676s) [noise=true , address=45.91.116.5:4297 , piece_id=PQRVZL5LQN3MSWBSOL2UJZEAHDKLMSPC4RTNJE2K4ULQ2UIPI7TA, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.141157765 (72h43m24.180730875s) [noise=true , address=45.91.116.6:4975 , piece_id=ZWBQZZD6F4X6WZVRENP3V67WSWBPERCZCYTUH7KVXF5S4C2LKJYA, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.152358098 (72h43m24.191931228s) [noise=true , address=45.91.116.7:4011 , piece_id=JYWYXCJNYENUDIRS2MA77XA2MS4ZAICPK6NP2KDHJP6HWBM23SWA, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.156393320 (72h43m24.19596644s) [noise=true , address=45.91.116.14:4189 , piece_id=NNPPMVE2Y5T43P3YLSFN7VWDRFKY2VWEH2H4SIYHJYQYZTSAM7YA, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.174049507 (72h43m24.213622627s) [noise=true , address=45.91.116.9:4262 , piece_id=XFHBBEHJCNLJ3SEQFG3VGLIPEEM5EISQ3IHOEIF6IFRPKN72DPCQ, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.197696197 (72h43m24.237269317s) [noise=true , address=77.90.31.21:4879 , piece_id=XQGOUODVJQ5WJ5ENMRE4SKXJFTG5PDOYI4Q7TBSXCZQVR7QPA2GQ, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.202199094 (72h43m24.241772214s) [noise=true , address=77.90.31.15:4698 , piece_id=FDDREIRFYA5LM52EOZ2OFMEKXW4B6UPNNZALIXN3MCOLN4CW6XXQ, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.273846830 (72h43m24.31341995s) [noise=true , address=145.79.227.11:4729 , piece_id=IURULFMZHYHLEBQTOVJ3PS4MCKHSAHM3WPVVWWD5QC5OUD7IOORQ, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.401715780 (72h43m24.4412889s) [noise=true , address=145.79.227.2:4115 , piece_id=WZYQH5JMVVRNIXYVTAH5F4W5LYPPLGYX2IICFMN6NURUDSJA4QIQ, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.462758512 (72h43m24.502331632s) [noise=true , address=145.79.227.4:4186 , piece_id=HRE2CHJKJQVQH3M67CWDIKHGLMO63SFF2RMG3PH26XSRH7KNPE3A, seg_pos={0 0}, upload=64004]: Done uploading piece. err: <nil> Sep 9 14:11:48.462787517 (72h43m24.502360637s) [seg_pos={0 0}, upload=64004]: Segment reached optimal threshold of 13 pieces. Sep 9 14:11:48.462965258 (72h43m24.502538388s) [noise=true , address=45.91.116.4:4937 , piece_id=UPQLY2N4WSONHRK2Q3T3ZAI5KXYWKH57M53B6M35SBBIF4VR7YQQ, seg_pos={0 0}, upload=64004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 9 14:11:48.463034359 (72h43m24.50260748s) [noise=true , address=77.90.31.21:4878 , piece_id=U3XWVYPZTZIXER76BOFPA2H6ZM2Y55FF5YJKGJRO2H4ERJBYGCYQ, seg_pos={0 0}, upload=64004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK): protocol: write tcp 188.166.225.170:35596->77.90.31.21:4878: use of closed network connection; write tcp 188.166.225.170:35596->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35596->77.90.31.21:4878: use of closed network connection Sep 9 14:11:48.463083454 (72h43m24.502656574s) [noise=true , address=77.90.31.17:4772 , piece_id=UMVQQBDM6JDEZR4GAR4OFBXAFU65QMC4K6YGKHP3UFOTBPKCCXUA, seg_pos={0 0}, upload=64004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: expected piece hash; context canceled; EOF Sep 9 14:11:48.463126737 (72h43m24.502699857s) [seg_pos={0 0}, upload=64004]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:11:48.463200838 (72h43m24.502773958s) [upload=64004]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:11:48.463205978 (72h43m24.502779108s) [upload=64004]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:11:48.798556054 (72h43m24.838129175s) [upload=64004]: Done uploading segments... Sep 9 14:11:48.798583988 (72h43m24.838157118s) [upload=64004]: Upload finished. err: <nil> Duration: 30.001591356s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.517816899s FAIL (2025-09-09 14:12:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.517844651s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.845062284s FAIL (2025-09-09 14:11:55 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.845095087s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [..X..........X............................XXXXXXX...XXXXXXXX] duration: 30.002272947s FAIL (2025-09-09 14:11:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:11:14.165506405 (72h42m50.205079525s) [upload=63995]: Starting upload Sep 9 14:11:14.165559576 (72h42m50.205132697s) [upload=63995]: Done starting upload Sep 9 14:11:14.165685418 (72h42m50.205258538s) [upload=63995]: Uploading segments... Sep 9 14:11:14.165773236 (72h42m50.205346356s) [upload=63995]: Got next segment. Inline: false Sep 9 14:11:14.165862486 (72h42m50.205435606s) [upload=63995]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:11:14.165867887 (72h42m50.205441007s) [upload=63995]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:11:14.677306175 (72h42m50.716879295s) [seg_pos={0 0}, upload=63995]: Begin upload segment... Sep 9 14:11:14.677363705 (72h42m50.716936825s) [seg_pos={0 0}, upload=63995]: Done begin upload segment. Sep 9 14:11:14.677387641 (72h42m50.716960751s) [noise=true , address=145.79.227.11:4731 , piece_id=23IVRM5LI5S3XRDGAN6XHGHZCJ45IV3OWA6FPMAV2GBJMISWWHVQ, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.677425995 (72h42m50.716999115s) [noise=true , address=145.79.227.17:4970 , piece_id=77YZLO6IEVAVNNUUTYVMIXOLXJ5CNXPH43XYGCWVGQMV6EHDLU6A, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.678012838 (72h42m50.717585958s) [noise=true , address=77.90.31.18:4805 , piece_id=CL7T7SAVS5DTC7GAYKCMWQRPFFRXEDEZAROCCWCJZB26S3HDMMRA, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.678073654 (72h42m50.717646774s) [noise=true , address=45.91.116.5:4297 , piece_id=WPLLQEVBYC3GANDY63TLZFFRXQEB4BM4URWKLJNVY4V5TJNQ6KAA, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.678288575 (72h42m50.717861695s) [noise=true , address=45.91.116.11:4118 , piece_id=BXZAWFAIXHGKGNWKI25NUPYGQ5DJQB7KKBIPYUPUHAIP34TYOTFA, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.678528855 (72h42m50.718101975s) [noise=true , address=45.91.116.9:4263 , piece_id=7RXSLCWH3HPAB5TVJ5D4SSBYG4P27STFVDJJBBJBRVQA3ZRV3YRQ, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.678787050 (72h42m50.71836017s) [noise=true , address=45.91.116.10:4083 , piece_id=JTEMZQYAX35ZU7DD43X2EGQVTSSUMORDEJ7BCVPXJUGQODKRVNOA, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.679690048 (72h42m50.719263158s) [noise=true , address=77.90.31.15:4697 , piece_id=GCGARB4ICGWTSKI2HIJX3E5DVSCR3JGSWWTNUKSW7YZS5CBMOTUQ, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.679969152 (72h42m50.719542272s) [noise=true , address=45.91.116.8:4045 , piece_id=724CHTAQ3QL7SA4RG7BMCPAEA5VXTPKYCZ6Z2LSJ2J7UG5KYVH5A, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.680239329 (72h42m50.719812449s) [noise=true , address=45.91.116.6:4975 , piece_id=LV5XMV5AOTMZQ3EOVON4UJI3VTEP6UTD3ON5WWWGJOZPVMCY7QGQ, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.680492473 (72h42m50.720065593s) [noise=true , address=45.91.116.7:4009 , piece_id=JBUHQD53HBFIQRLJNT73Y46U2F4BPJKJ45BIVTPJNSFOJX33GRZQ, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.681854569 (72h42m50.7214277s) [noise=true , address=77.90.31.12:4589 , piece_id=YB4GVGYFR3K4DCVLBU75WFP45E4X62BZUEDFMVKPNH63XH7MONRA, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.682768087 (72h42m50.722341207s) [noise=true , address=45.91.116.6:4973 , piece_id=5ID4F32R3QOBLOO2PQFR6LCX57GCDG3YFRLIUIFTVUE2AAMNDRVQ, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.683030309 (72h42m50.722603429s) [noise=true , address=77.90.31.19:4842 , piece_id=4YI4S75O22DXYVHJRJNAVTCFDHAMID7LLVEPK6RT5T7RZ35WBM5A, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.683339400 (72h42m50.72291252s) [noise=true , address=45.91.116.14:4190 , piece_id=YWNRXEPPUGJQPK62T5B6UXBN6SHKNLSGET7WLFGZRE4BRWU7VE5A, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:14.683610289 (72h42m50.723183409s) [noise=true , address=145.79.227.3:4151 , piece_id=U6NRJ66UOQPXME6XSAE5MAFUKSEEPHN3IIDPQSF2VAOTRU75WKOQ, seg_pos={0 0}, upload=63995]: Uploading piece... Sep 9 14:11:16.514622472 (72h42m52.554195592s) [upload=63995]: Next returned nil segment Sep 9 14:11:16.514643082 (72h42m52.554216202s) [upload=63995]: Waiting for error group managing segments... Sep 9 14:11:16.854542284 (72h42m52.894115404s) [noise=true , address=45.91.116.6:4975 , piece_id=LV5XMV5AOTMZQ3EOVON4UJI3VTEP6UTD3ON5WWWGJOZPVMCY7QGQ, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:16.869980907 (72h42m52.909554027s) [noise=true , address=145.79.227.17:4970 , piece_id=77YZLO6IEVAVNNUUTYVMIXOLXJ5CNXPH43XYGCWVGQMV6EHDLU6A, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:16.910861556 (72h42m52.950434676s) [noise=true , address=77.90.31.12:4589 , piece_id=YB4GVGYFR3K4DCVLBU75WFP45E4X62BZUEDFMVKPNH63XH7MONRA, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:16.918055773 (72h42m52.957628893s) [noise=true , address=45.91.116.5:4297 , piece_id=WPLLQEVBYC3GANDY63TLZFFRXQEB4BM4URWKLJNVY4V5TJNQ6KAA, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:16.919911594 (72h42m52.959484725s) [noise=true , address=45.91.116.6:4973 , piece_id=5ID4F32R3QOBLOO2PQFR6LCX57GCDG3YFRLIUIFTVUE2AAMNDRVQ, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:16.923860261 (72h42m52.963433401s) [noise=true , address=45.91.116.14:4190 , piece_id=YWNRXEPPUGJQPK62T5B6UXBN6SHKNLSGET7WLFGZRE4BRWU7VE5A, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:16.936759896 (72h42m52.976333016s) [noise=true , address=45.91.116.10:4083 , piece_id=JTEMZQYAX35ZU7DD43X2EGQVTSSUMORDEJ7BCVPXJUGQODKRVNOA, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:16.986653753 (72h42m53.026226883s) [noise=true , address=77.90.31.18:4805 , piece_id=CL7T7SAVS5DTC7GAYKCMWQRPFFRXEDEZAROCCWCJZB26S3HDMMRA, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:17.094111885 (72h42m53.133685005s) [noise=true , address=45.91.116.9:4263 , piece_id=7RXSLCWH3HPAB5TVJ5D4SSBYG4P27STFVDJJBBJBRVQA3ZRV3YRQ, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:17.151823302 (72h42m53.191396422s) [noise=true , address=145.79.227.11:4731 , piece_id=23IVRM5LI5S3XRDGAN6XHGHZCJ45IV3OWA6FPMAV2GBJMISWWHVQ, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:17.265181284 (72h42m53.304754404s) [noise=true , address=45.91.116.11:4118 , piece_id=BXZAWFAIXHGKGNWKI25NUPYGQ5DJQB7KKBIPYUPUHAIP34TYOTFA, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:17.444234380 (72h42m53.48380753s) [noise=true , address=77.90.31.15:4697 , piece_id=GCGARB4ICGWTSKI2HIJX3E5DVSCR3JGSWWTNUKSW7YZS5CBMOTUQ, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:17.620686661 (72h42m53.660259781s) [noise=true , address=45.91.116.8:4045 , piece_id=724CHTAQ3QL7SA4RG7BMCPAEA5VXTPKYCZ6Z2LSJ2J7UG5KYVH5A, seg_pos={0 0}, upload=63995]: Done uploading piece. err: <nil> Sep 9 14:11:17.620721387 (72h42m53.660294497s) [seg_pos={0 0}, upload=63995]: Segment reached optimal threshold of 13 pieces. Sep 9 14:11:17.620844824 (72h42m53.660417944s) [noise=true , address=45.91.116.7:4009 , piece_id=JBUHQD53HBFIQRLJNT73Y46U2F4BPJKJ45BIVTPJNSFOJX33GRZQ, seg_pos={0 0}, upload=63995]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF Sep 9 14:11:17.620936819 (72h42m53.660509949s) [noise=true , address=77.90.31.19:4842 , piece_id=4YI4S75O22DXYVHJRJNAVTCFDHAMID7LLVEPK6RT5T7RZ35WBM5A, seg_pos={0 0}, upload=63995]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF Sep 9 14:11:17.620946127 (72h42m53.660519247s) [noise=true , address=145.79.227.3:4151 , piece_id=U6NRJ66UOQPXME6XSAE5MAFUKSEEPHN3IIDPQSF2VAOTRU75WKOQ, seg_pos={0 0}, upload=63995]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF Sep 9 14:11:17.620960254 (72h42m53.660533374s) [seg_pos={0 0}, upload=63995]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:11:17.621025459 (72h42m53.660598579s) [upload=63995]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:11:17.621029306 (72h42m53.660602426s) [upload=63995]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:11:17.985420477 (72h42m54.024993607s) [upload=63995]: Done uploading segments... Sep 9 14:11:17.985443351 (72h42m54.025016481s) [upload=63995]: Upload finished. err: <nil> Duration: 30.00228977s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.645045392s FAIL (2025-09-09 14:11:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.645077612s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [...X..........X............................XXXXXXX...XXXXXXX] duration: 30.001808704s FAIL (2025-09-09 14:11:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:10:43.914137480 (72h42m19.9537106s) [upload=63985]: Starting upload Sep 9 14:10:43.914194159 (72h42m19.953767279s) [upload=63985]: Done starting upload Sep 9 14:10:43.914296895 (72h42m19.953870015s) [upload=63985]: Uploading segments... Sep 9 14:10:43.914370006 (72h42m19.953943126s) [upload=63985]: Got next segment. Inline: false Sep 9 14:10:43.914399562 (72h42m19.953972682s) [upload=63985]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:10:43.914404361 (72h42m19.953977481s) [upload=63985]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:10:44.447589344 (72h42m20.487162464s) [seg_pos={0 0}, upload=63985]: Begin upload segment... Sep 9 14:10:44.447626816 (72h42m20.487199936s) [seg_pos={0 0}, upload=63985]: Done begin upload segment. Sep 9 14:10:44.447648207 (72h42m20.487221327s) [noise=true , address=145.79.227.5:4222 , piece_id=QBGCZID7Z4FS2VVVQZPDRMLYSBOLPVNEXGLB7JJJM2LQ65PTA2NA, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.447666722 (72h42m20.487239852s) [noise=true , address=145.79.227.7:4295 , piece_id=S3ZSEEXHEMP7TMIN6AJX434SOQ6ZG4PWWQRNFA3ZXHECG4WRYGBA, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.448008907 (72h42m20.487582027s) [noise=true , address=45.91.116.13:4153 , piece_id=PWRYTU7HYXLC2FUTLCCA2J5ASNIZ5WGODIKXOS6DGSD3DHE2PHTQ, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.448194773 (72h42m20.487767903s) [noise=true , address=45.91.116.12:4226 , piece_id=LCSSXLYL6PKZQ7PVU46XYAGFNMCDAGAHMGWIV2GFY5IGLRE32FTQ, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.448267431 (72h42m20.487840551s) [noise=true , address=45.91.116.5:4297 , piece_id=X7NJC2PIHX54PGSPVYFXZ6PFTOXYWO3U7FSLN4E7U25HEJDK5PKQ, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.448544422 (72h42m20.488117542s) [noise=true , address=77.90.31.18:4806 , piece_id=L77UBWO3KM6IOIPY4PRM2QYEJUTLAIOQ4QWKGRFCJHOKCHQF5HDQ, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.448680893 (72h42m20.488254013s) [noise=true , address=45.91.116.6:4974 , piece_id=FC2PE3RGNIQJM6KYAFPFFYV5G72BDRIVT66UCFPK7NUVPQMQFG5Q, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.448799159 (72h42m20.488372279s) [noise=true , address=77.90.31.15:4698 , piece_id=PHAKTIKLLCKRFLUYGO3DQK3EK62RK47S3WKZIEH76P4PIQ5KG4MA, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.449050871 (72h42m20.488623991s) [noise=true , address=45.91.116.4:4937 , piece_id=E2UTWRDLSYTFWICF23Y2Z7UAFCPVMEUZZKQA33PCQ2TZZ7NWE7HQ, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.449179788 (72h42m20.488752908s) [noise=true , address=45.91.116.5:4298 , piece_id=DKQI5CI2D5WZJH7VHA2QUAK2EWLVJ2QZFMNWUM43KOKPYTLVRAGQ, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.449246415 (72h42m20.488819535s) [noise=true , address=45.91.116.9:4261 , piece_id=37SBPJVDMAC4DSO2WOYFMI3UFNEKMMYQLJOYD5K2EDPTUMDCH5PQ, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.449475984 (72h42m20.489049105s) [noise=true , address=77.90.31.13:4628 , piece_id=NQFDO6DE6ATVDQVPIWA7OEOAWEUSB2BFQO75SM2Y3X23YQ2B4D6A, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.449591425 (72h42m20.489164545s) [noise=true , address=45.91.116.11:4117 , piece_id=HDTD7S3PDUMIKKO3A4JRXTJXRNK2HSIH5GPNV3GRSF5MFXZBCBNA, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.449718939 (72h42m20.48929206s) [noise=true , address=45.91.116.14:4190 , piece_id=EGEJT4TQQ2CKQJDBZJTRCQUCUCDHXEK7GKN6OLAM4GDMGVAJAKIQ, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.450054862 (72h42m20.489627982s) [noise=true , address=77.90.31.12:4590 , piece_id=7DM3ABJOMR3SXSCFXPE2KW5KC5LPSA3JIDFW5KXIB224EZUG7BYQ, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:44.450411214 (72h42m20.489984334s) [noise=true , address=145.79.227.4:4186 , piece_id=ABPUZHC2WCP7QKYBR7H5FABT2KSARRK6DCPXJAB6ALFFHUF2JHGA, seg_pos={0 0}, upload=63985]: Uploading piece... Sep 9 14:10:46.328617711 (72h42m22.368190851s) [upload=63985]: Next returned nil segment Sep 9 14:10:46.328651135 (72h42m22.368224275s) [upload=63985]: Waiting for error group managing segments... Sep 9 14:10:46.638061794 (72h42m22.677634915s) [noise=true , address=45.91.116.6:4974 , piece_id=FC2PE3RGNIQJM6KYAFPFFYV5G72BDRIVT66UCFPK7NUVPQMQFG5Q, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.663092552 (72h42m22.702665673s) [noise=true , address=45.91.116.9:4261 , piece_id=37SBPJVDMAC4DSO2WOYFMI3UFNEKMMYQLJOYD5K2EDPTUMDCH5PQ, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.683309621 (72h42m22.722882741s) [noise=true , address=45.91.116.13:4153 , piece_id=PWRYTU7HYXLC2FUTLCCA2J5ASNIZ5WGODIKXOS6DGSD3DHE2PHTQ, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.686009066 (72h42m22.725582216s) [noise=true , address=45.91.116.12:4226 , piece_id=LCSSXLYL6PKZQ7PVU46XYAGFNMCDAGAHMGWIV2GFY5IGLRE32FTQ, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.687794993 (72h42m22.727368113s) [noise=true , address=45.91.116.5:4298 , piece_id=DKQI5CI2D5WZJH7VHA2QUAK2EWLVJ2QZFMNWUM43KOKPYTLVRAGQ, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.704332290 (72h42m22.74390541s) [noise=true , address=45.91.116.11:4117 , piece_id=HDTD7S3PDUMIKKO3A4JRXTJXRNK2HSIH5GPNV3GRSF5MFXZBCBNA, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.708869993 (72h42m22.748443113s) [noise=true , address=77.90.31.18:4806 , piece_id=L77UBWO3KM6IOIPY4PRM2QYEJUTLAIOQ4QWKGRFCJHOKCHQF5HDQ, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.710422744 (72h42m22.749995864s) [noise=true , address=77.90.31.15:4698 , piece_id=PHAKTIKLLCKRFLUYGO3DQK3EK62RK47S3WKZIEH76P4PIQ5KG4MA, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.728887819 (72h42m22.768460939s) [noise=true , address=77.90.31.13:4628 , piece_id=NQFDO6DE6ATVDQVPIWA7OEOAWEUSB2BFQO75SM2Y3X23YQ2B4D6A, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.751220014 (72h42m22.790793124s) [noise=true , address=45.91.116.4:4937 , piece_id=E2UTWRDLSYTFWICF23Y2Z7UAFCPVMEUZZKQA33PCQ2TZZ7NWE7HQ, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.783019225 (72h42m22.822592345s) [noise=true , address=77.90.31.12:4590 , piece_id=7DM3ABJOMR3SXSCFXPE2KW5KC5LPSA3JIDFW5KXIB224EZUG7BYQ, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.822386248 (72h42m22.861959368s) [noise=true , address=145.79.227.7:4295 , piece_id=S3ZSEEXHEMP7TMIN6AJX434SOQ6ZG4PWWQRNFA3ZXHECG4WRYGBA, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.831565093 (72h42m22.871138213s) [noise=true , address=45.91.116.14:4190 , piece_id=EGEJT4TQQ2CKQJDBZJTRCQUCUCDHXEK7GKN6OLAM4GDMGVAJAKIQ, seg_pos={0 0}, upload=63985]: Done uploading piece. err: <nil> Sep 9 14:10:46.831598286 (72h42m22.871171406s) [seg_pos={0 0}, upload=63985]: Segment reached optimal threshold of 13 pieces. Sep 9 14:10:46.831759565 (72h42m22.871332685s) [noise=true , address=145.79.227.5:4222 , piece_id=QBGCZID7Z4FS2VVVQZPDRMLYSBOLPVNEXGLB7JJJM2LQ65PTA2NA, seg_pos={0 0}, upload=63985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 9 14:10:46.831831071 (72h42m22.871404191s) [noise=true , address=145.79.227.4:4186 , piece_id=ABPUZHC2WCP7QKYBR7H5FABT2KSARRK6DCPXJAB6ALFFHUF2JHGA, seg_pos={0 0}, upload=63985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht): protocol: expected piece hash; context canceled; EOF Sep 9 14:10:46.831949158 (72h42m22.871522278s) [noise=true , address=45.91.116.5:4297 , piece_id=X7NJC2PIHX54PGSPVYFXZ6PFTOXYWO3U7FSLN4E7U25HEJDK5PKQ, seg_pos={0 0}, upload=63985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:49954->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:49954->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49954->45.91.116.5:4297: use of closed network connection Sep 9 14:10:46.831990466 (72h42m22.871563586s) [seg_pos={0 0}, upload=63985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:10:46.832079055 (72h42m22.871652175s) [upload=63985]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:10:46.832084166 (72h42m22.871657286s) [upload=63985]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:10:47.198425988 (72h42m23.237999148s) [upload=63985]: Done uploading segments... Sep 9 14:10:47.198447309 (72h42m23.238020429s) [upload=63985]: Upload finished. err: <nil> Duration: 30.001820317s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.969758624s FAIL (2025-09-09 14:11:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.969782831s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 15 out of 60 is failed (threshold=3) [....X..........X............................XXXXXXX...XXXXXX] duration: 30.002674318s FAIL (2025-09-09 14:10:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:10:13.575543677 (72h41m49.615116797s) [upload=63980]: Starting upload Sep 9 14:10:13.575601828 (72h41m49.615174948s) [upload=63980]: Done starting upload Sep 9 14:10:13.575708562 (72h41m49.615281682s) [upload=63980]: Uploading segments... Sep 9 14:10:13.575792963 (72h41m49.615366084s) [upload=63980]: Got next segment. Inline: false Sep 9 14:10:13.575827500 (72h41m49.61540062s) [upload=63980]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:10:13.575832159 (72h41m49.615405279s) [upload=63980]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:10:13.819827851 (72h41m49.859400971s) [seg_pos={0 0}, upload=63980]: Begin upload segment... Sep 9 14:10:13.819863138 (72h41m49.859436258s) [seg_pos={0 0}, upload=63980]: Done begin upload segment. Sep 9 14:10:13.819882155 (72h41m49.859455275s) [noise=true , address=45.91.116.12:4225 , piece_id=FKIPVZOHJ7FCQPHFOMDEXUBN5UH3IEMWKR2Z6AJ6U6DAYRC75WZQ, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.819899097 (72h41m49.859472217s) [noise=true , address=45.91.116.6:4975 , piece_id=TXUTU5YGYRXSWL5RBCBHVSOIQQ4HPEOOB66XWMMM45SXI7XOPDGQ, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.820214882 (72h41m49.859788002s) [noise=true , address=45.91.116.7:4010 , piece_id=NSO6U55FTYM2KVHYP2JHYU5ETUTH5EKAEPGLGBIKRAKTALGUTAOA, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.820220121 (72h41m49.859793241s) [noise=true , address=77.90.31.14:4662 , piece_id=7X5VQNDB2ENIQXWID7UBKVAEHFFR7W6ALNZAWVPZNXSHBOAEEK6A, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.820781926 (72h41m49.860355046s) [noise=true , address=45.91.116.13:4154 , piece_id=AT36JUOONID7QLDTMCOQMKLEZOJRBRUGTVW76C5IBC4QUXEI6BTQ, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.821239151 (72h41m49.860812271s) [noise=true , address=77.90.31.18:4806 , piece_id=X23OOKRCIIHMM6Y4MNNEACPRDOFYBMSTASSDZYY3ZEWK7GJJALVA, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.821583781 (72h41m49.861156891s) [noise=true , address=77.90.31.19:4843 , piece_id=NUEXTUXIK7TYLJSTO5PZBLUXPVO5A5F2RMKSLYVTEHEMCBGYQHXQ, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.822199068 (72h41m49.861772188s) [noise=true , address=145.79.227.16:4912 , piece_id=NHKTDJU763DLN4WH4Z64PZLQW2UJDDRQMZG747RE6JIDH3ZRT6XA, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.822797854 (72h41m49.862370974s) [noise=true , address=77.90.31.13:4626 , piece_id=DIZK7IAUVAEDFLA5UBQJB27NCRMXZYCNHYQJVBXP3AILAEAQXODQ, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.823306868 (72h41m49.862879988s) [noise=true , address=77.90.31.17:4772 , piece_id=SEATAWOODMOCWGY6LT225IFSRPFOBW5BMCBUE4RQIRC5QAHMWELA, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.823866990 (72h41m49.86344011s) [noise=true , address=45.91.116.8:4045 , piece_id=KYTZUSPSFU7HNEBLFHQ5XWP4YUO7WGCGMA5BMQFFEMM7VMC7LQCA, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.824533726 (72h41m49.864106846s) [noise=true , address=145.79.227.13:4804 , piece_id=TMI7QHRNZ53CIQOZZQO7IID5WQFBYJ55YXMTWN3HIE7YH7HF7GNA, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.824777432 (72h41m49.864350552s) [noise=true , address=145.79.227.3:4149 , piece_id=X26MYKLRD4DKECU6U5NLTIPKIQZ2HAZLRBJ2TCHPRDHWU3NNPFSA, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.825000679 (72h41m49.864573799s) [noise=true , address=77.90.31.16:4735 , piece_id=ZVG54O55P5KUKC2MGXLEJUOHX46ODEYMYXELZR4SEES2GMQMADLA, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.825683365 (72h41m49.865256486s) [noise=true , address=45.91.116.14:4189 , piece_id=TZQCC5GMLY7TT24O43BTXXG2E25B4NY56M6XTXUP7DY33UO4A2JQ, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:13.826023537 (72h41m49.865596667s) [noise=true , address=45.91.116.10:4082 , piece_id=BHZRTHJHFJMHYGFVBNU7KQWOVACRYUGEBFXVWOITD6NFV2HK6SOQ, seg_pos={0 0}, upload=63980]: Uploading piece... Sep 9 14:10:15.715640045 (72h41m51.755213195s) [upload=63980]: Next returned nil segment Sep 9 14:10:15.715661566 (72h41m51.755234696s) [upload=63980]: Waiting for error group managing segments... Sep 9 14:10:16.054771128 (72h41m52.094344248s) [noise=true , address=77.90.31.13:4626 , piece_id=DIZK7IAUVAEDFLA5UBQJB27NCRMXZYCNHYQJVBXP3AILAEAQXODQ, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.092169343 (72h41m52.131742463s) [noise=true , address=145.79.227.16:4912 , piece_id=NHKTDJU763DLN4WH4Z64PZLQW2UJDDRQMZG747RE6JIDH3ZRT6XA, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.098843274 (72h41m52.138416414s) [noise=true , address=45.91.116.10:4082 , piece_id=BHZRTHJHFJMHYGFVBNU7KQWOVACRYUGEBFXVWOITD6NFV2HK6SOQ, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.111206923 (72h41m52.150780043s) [noise=true , address=77.90.31.17:4772 , piece_id=SEATAWOODMOCWGY6LT225IFSRPFOBW5BMCBUE4RQIRC5QAHMWELA, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.123921734 (72h41m52.163494854s) [noise=true , address=45.91.116.14:4189 , piece_id=TZQCC5GMLY7TT24O43BTXXG2E25B4NY56M6XTXUP7DY33UO4A2JQ, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.127757174 (72h41m52.167330294s) [noise=true , address=77.90.31.16:4735 , piece_id=ZVG54O55P5KUKC2MGXLEJUOHX46ODEYMYXELZR4SEES2GMQMADLA, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.136269833 (72h41m52.175842943s) [noise=true , address=45.91.116.8:4045 , piece_id=KYTZUSPSFU7HNEBLFHQ5XWP4YUO7WGCGMA5BMQFFEMM7VMC7LQCA, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.175343565 (72h41m52.214916705s) [noise=true , address=77.90.31.14:4662 , piece_id=7X5VQNDB2ENIQXWID7UBKVAEHFFR7W6ALNZAWVPZNXSHBOAEEK6A, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.181465790 (72h41m52.22103891s) [noise=true , address=77.90.31.19:4843 , piece_id=NUEXTUXIK7TYLJSTO5PZBLUXPVO5A5F2RMKSLYVTEHEMCBGYQHXQ, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.211938423 (72h41m52.251511543s) [noise=true , address=145.79.227.3:4149 , piece_id=X26MYKLRD4DKECU6U5NLTIPKIQZ2HAZLRBJ2TCHPRDHWU3NNPFSA, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.278080632 (72h41m52.317653752s) [noise=true , address=45.91.116.13:4154 , piece_id=AT36JUOONID7QLDTMCOQMKLEZOJRBRUGTVW76C5IBC4QUXEI6BTQ, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.921439356 (72h41m52.961012476s) [noise=true , address=45.91.116.6:4975 , piece_id=TXUTU5YGYRXSWL5RBCBHVSOIQQ4HPEOOB66XWMMM45SXI7XOPDGQ, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.966973340 (72h41m53.00654646s) [noise=true , address=77.90.31.18:4806 , piece_id=X23OOKRCIIHMM6Y4MNNEACPRDOFYBMSTASSDZYY3ZEWK7GJJALVA, seg_pos={0 0}, upload=63980]: Done uploading piece. err: <nil> Sep 9 14:10:16.967002586 (72h41m53.006575706s) [seg_pos={0 0}, upload=63980]: Segment reached optimal threshold of 13 pieces. Sep 9 14:10:16.967188342 (72h41m53.006761462s) [noise=true , address=145.79.227.13:4804 , piece_id=TMI7QHRNZ53CIQOZZQO7IID5WQFBYJ55YXMTWN3HIE7YH7HF7GNA, seg_pos={0 0}, upload=63980]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: expected piece hash; context canceled; EOF Sep 9 14:10:16.967364890 (72h41m53.00693801s) [noise=true , address=45.91.116.12:4225 , piece_id=FKIPVZOHJ7FCQPHFOMDEXUBN5UH3IEMWKR2Z6AJ6U6DAYRC75WZQ, seg_pos={0 0}, upload=63980]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:43538->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:43538->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43538->45.91.116.12:4225: use of closed network connection Sep 9 14:10:16.967410707 (72h41m53.006983837s) [noise=true , address=45.91.116.7:4010 , piece_id=NSO6U55FTYM2KVHYP2JHYU5ETUTH5EKAEPGLGBIKRAKTALGUTAOA, seg_pos={0 0}, upload=63980]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: write tcp 188.166.225.170:40084->45.91.116.7:4010: use of closed network connection; write tcp 188.166.225.170:40084->45.91.116.7:4010: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40084->45.91.116.7:4010: use of closed network connection Sep 9 14:10:16.967434192 (72h41m53.007007322s) [seg_pos={0 0}, upload=63980]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:10:16.967536538 (72h41m53.007109658s) [upload=63980]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:10:16.967542930 (72h41m53.00711605s) [upload=63980]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:10:17.276288608 (72h41m53.315861728s) [upload=63980]: Done uploading segments... Sep 9 14:10:17.276310039 (72h41m53.315883159s) [upload=63980]: Upload finished. err: <nil> Duration: 30.002703766s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.305343544s FAIL (2025-09-09 14:10:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.305365316s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.....X..........X............................XXXXXXX...XXXXX] duration: 30.003247762s FAIL (2025-09-09 14:10:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:09:36.789399990 (72h41m12.828973141s) [upload=63971]: Starting upload Sep 9 14:09:36.789514509 (72h41m12.829087629s) [upload=63971]: Done starting upload Sep 9 14:09:36.789637134 (72h41m12.829210304s) [upload=63971]: Uploading segments... Sep 9 14:09:36.789962246 (72h41m12.829535406s) [upload=63971]: Got next segment. Inline: false Sep 9 14:09:36.790030156 (72h41m12.829603276s) [upload=63971]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:09:36.790036999 (72h41m12.829610119s) [upload=63971]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:09:37.269845483 (72h41m13.309418603s) [seg_pos={0 0}, upload=63971]: Begin upload segment... Sep 9 14:09:37.269884858 (72h41m13.309458018s) [seg_pos={0 0}, upload=63971]: Done begin upload segment. Sep 9 14:09:37.269962006 (72h41m13.309535126s) [noise=true , address=77.90.31.14:4661 , piece_id=MAIR227SPSJG2H6TBEUIM5SEGZHPHWIRK5YCSIVXGXNLL33RKO7A, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.270054573 (72h41m13.309627703s) [noise=true , address=45.91.116.14:4190 , piece_id=CHY4X2U4PRCEDVXGU4VWGBDBUFVMBKOTO2URPAZGCUVBQYM3MEXQ, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.270334909 (72h41m13.309908019s) [noise=true , address=77.90.31.12:4590 , piece_id=HYISGTQCRIPFZAK7DIUJ2DAIVMLYG34MJTKLODFIAX7XW64SAMTA, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.270679579 (72h41m13.310252699s) [noise=true , address=77.90.31.15:4698 , piece_id=ASEHXKX332WUURDCVBAV7EBTR5JLYY22OM43UN3TZYNLTNO6WOCA, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.270768258 (72h41m13.310341378s) [noise=true , address=45.91.116.8:4048 , piece_id=L7TKZOXLMZ7NJVJBMI2S7DKXCHMTVZRKV3DFP63462YNC4QGF6TA, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.271059276 (72h41m13.310632396s) [noise=true , address=77.90.31.19:4842 , piece_id=6KRMYYIDWKGZHTB7MVKEMI6NYCA4MSUPVU3KMDP7MZD4QS5QXX3Q, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.271229992 (72h41m13.310803112s) [noise=true , address=77.90.31.21:4877 , piece_id=Z5KDCORS4ADHKA2JXGZFR6Y6LYG75XSVBCB45N34BLP5GH6LSURA, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.271426187 (72h41m13.310999337s) [noise=true , address=45.91.116.9:4261 , piece_id=56HONYP35USGLPRAAZQVDU2TLUQJSBMJL6POYC6Z2IP5KR77XS3Q, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.271668040 (72h41m13.31124116s) [noise=true , address=77.90.31.10:4519 , piece_id=R56KBHNJ66EST5MEAW2TUNAYNTHZJ2NASJCTHAYNLQ36D35RH3ZQ, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.271734999 (72h41m13.311308119s) [noise=true , address=45.91.116.11:4119 , piece_id=X2ORJOZYBS3VRKQJNX37YX35LZI3PX6REEN5YVQNTKJBZDMGJBCQ, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.271964107 (72h41m13.311537217s) [noise=true , address=145.79.227.16:4911 , piece_id=ASFMHOSJD3JW64DIDQRONEZUUE4OBBVL27DXCJA4DDBNYSSMGSHQ, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.272102942 (72h41m13.311676062s) [noise=true , address=45.91.116.6:4975 , piece_id=BTP7WEGIRX5U4SAPFNRQFWILXWEFY6FQIRIEGCSMSEYNS66VJRZQ, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.272187664 (72h41m13.311760784s) [noise=true , address=77.90.31.17:4772 , piece_id=TQUYLGTTQ56RQPREGEXVFUWGHPOLH46NZFHB3O6LFRJG6M36AN5A, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.272349815 (72h41m13.311922935s) [noise=true , address=45.91.116.5:4299 , piece_id=ZMXOODAU6E7WACSDNWZS4WC3RBOYNUAVA6XP4DU6SP27TU5C3QSA, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.272580477 (72h41m13.312153597s) [noise=true , address=45.91.116.14:4191 , piece_id=5JESHRDEYWU23ZMXYZCBNLMXMSLFTX7B7YED5FZTFFQUCDHUF2TQ, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:37.273243094 (72h41m13.312816214s) [noise=true , address=45.91.116.13:4153 , piece_id=DPQ4PVCNPQIJCBRD77WEXMKL6Q32VRBE3CXOBHIMELIFU7ZKMBDA, seg_pos={0 0}, upload=63971]: Uploading piece... Sep 9 14:09:39.118635163 (72h41m15.158208283s) [upload=63971]: Next returned nil segment Sep 9 14:09:39.118653578 (72h41m15.158226698s) [upload=63971]: Waiting for error group managing segments... Sep 9 14:09:39.489571317 (72h41m15.529144437s) [noise=true , address=77.90.31.10:4519 , piece_id=R56KBHNJ66EST5MEAW2TUNAYNTHZJ2NASJCTHAYNLQ36D35RH3ZQ, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.489869287 (72h41m15.529442487s) [noise=true , address=45.91.116.6:4975 , piece_id=BTP7WEGIRX5U4SAPFNRQFWILXWEFY6FQIRIEGCSMSEYNS66VJRZQ, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.520803153 (72h41m15.560376263s) [noise=true , address=45.91.116.14:4191 , piece_id=5JESHRDEYWU23ZMXYZCBNLMXMSLFTX7B7YED5FZTFFQUCDHUF2TQ, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.531111990 (72h41m15.57068511s) [noise=true , address=77.90.31.15:4698 , piece_id=ASEHXKX332WUURDCVBAV7EBTR5JLYY22OM43UN3TZYNLTNO6WOCA, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.532278112 (72h41m15.571851232s) [noise=true , address=77.90.31.17:4772 , piece_id=TQUYLGTTQ56RQPREGEXVFUWGHPOLH46NZFHB3O6LFRJG6M36AN5A, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.580428652 (72h41m15.620001772s) [noise=true , address=45.91.116.14:4190 , piece_id=CHY4X2U4PRCEDVXGU4VWGBDBUFVMBKOTO2URPAZGCUVBQYM3MEXQ, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.582259285 (72h41m15.621832405s) [noise=true , address=77.90.31.21:4877 , piece_id=Z5KDCORS4ADHKA2JXGZFR6Y6LYG75XSVBCB45N34BLP5GH6LSURA, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.621028704 (72h41m15.660601824s) [noise=true , address=77.90.31.12:4590 , piece_id=HYISGTQCRIPFZAK7DIUJ2DAIVMLYG34MJTKLODFIAX7XW64SAMTA, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.633192110 (72h41m15.67276523s) [noise=true , address=45.91.116.5:4299 , piece_id=ZMXOODAU6E7WACSDNWZS4WC3RBOYNUAVA6XP4DU6SP27TU5C3QSA, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.679127884 (72h41m15.718701004s) [noise=true , address=77.90.31.14:4661 , piece_id=MAIR227SPSJG2H6TBEUIM5SEGZHPHWIRK5YCSIVXGXNLL33RKO7A, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.691640388 (72h41m15.731213508s) [noise=true , address=77.90.31.19:4842 , piece_id=6KRMYYIDWKGZHTB7MVKEMI6NYCA4MSUPVU3KMDP7MZD4QS5QXX3Q, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.750649938 (72h41m15.790223059s) [noise=true , address=145.79.227.16:4911 , piece_id=ASFMHOSJD3JW64DIDQRONEZUUE4OBBVL27DXCJA4DDBNYSSMGSHQ, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.979530626 (72h41m16.019103756s) [noise=true , address=45.91.116.13:4153 , piece_id=DPQ4PVCNPQIJCBRD77WEXMKL6Q32VRBE3CXOBHIMELIFU7ZKMBDA, seg_pos={0 0}, upload=63971]: Done uploading piece. err: <nil> Sep 9 14:09:39.979578297 (72h41m16.019151417s) [seg_pos={0 0}, upload=63971]: Segment reached optimal threshold of 13 pieces. Sep 9 14:09:39.979696593 (72h41m16.019269713s) [noise=true , address=45.91.116.11:4119 , piece_id=X2ORJOZYBS3VRKQJNX37YX35LZI3PX6REEN5YVQNTKJBZDMGJBCQ, seg_pos={0 0}, upload=63971]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 14:09:39.979736680 (72h41m16.01930979s) [noise=true , address=45.91.116.9:4261 , piece_id=56HONYP35USGLPRAAZQVDU2TLUQJSBMJL6POYC6Z2IP5KR77XS3Q, seg_pos={0 0}, upload=63971]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Sep 9 14:09:39.979819098 (72h41m16.019392208s) [noise=true , address=45.91.116.8:4048 , piece_id=L7TKZOXLMZ7NJVJBMI2S7DKXCHMTVZRKV3DFP63462YNC4QGF6TA, seg_pos={0 0}, upload=63971]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:45306->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:45306->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45306->45.91.116.8:4048: use of closed network connection Sep 9 14:09:39.979847292 (72h41m16.019420412s) [seg_pos={0 0}, upload=63971]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:09:39.979989664 (72h41m16.019562784s) [upload=63971]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:09:39.979994263 (72h41m16.019567383s) [upload=63971]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:09:40.533672853 (72h41m16.573245973s) [upload=63971]: Done uploading segments... Sep 9 14:09:40.533690918 (72h41m16.573264038s) [upload=63971]: Upload finished. err: <nil> Duration: 30.00326232s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [......X..........X............................XXXXXXX...XXXX] duration: 30.002303208s FAIL (2025-09-09 14:09:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:09:06.557101781 (72h40m42.596674911s) [upload=63964]: Starting upload Sep 9 14:09:06.557158179 (72h40m42.596731299s) [upload=63964]: Done starting upload Sep 9 14:09:06.557219617 (72h40m42.596792758s) [upload=63964]: Uploading segments... Sep 9 14:09:06.557391336 (72h40m42.596964456s) [upload=63964]: Got next segment. Inline: false Sep 9 14:09:06.557436061 (72h40m42.597009211s) [upload=63964]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:09:06.557442654 (72h40m42.597015824s) [upload=63964]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:09:07.046367451 (72h40m43.085940581s) [seg_pos={0 0}, upload=63964]: Begin upload segment... Sep 9 14:09:07.046450620 (72h40m43.08602374s) [seg_pos={0 0}, upload=63964]: Done begin upload segment. Sep 9 14:09:07.046483573 (72h40m43.086056693s) [noise=true , address=77.90.31.15:4699 , piece_id=IKFZF4HF5FT5XSJ7T7TFZFBYUKGVIOITX3IQVYM3KAH5S5ERQZLA, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.046539822 (72h40m43.086112942s) [noise=true , address=45.91.116.4:4939 , piece_id=UBH4P7V2TPJYN2UFSDBP7WTIGYEF67PU7XVD7YTM77BQ56WLXJFQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.047047663 (72h40m43.086620783s) [noise=true , address=77.90.31.10:4517 , piece_id=3DO4BC44OUNOHU3GKD3S7IPOHFG5NIHUNQVJKT734TOUUZ25FVFQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.047345693 (72h40m43.086918813s) [noise=true , address=45.91.116.4:4938 , piece_id=5DDNFJ4UHRX4TMTQAGJ5ZHRVTJDPQDNYCESHLVMMCFAFV7YA7WBQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.048245255 (72h40m43.087818375s) [noise=true , address=77.90.31.17:4772 , piece_id=GYDYAOROFLZZ6OO7CRF4I7ST6AWEUBXINYUFZUSJ6YY3BRIJC5NQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.048632325 (72h40m43.088205445s) [noise=true , address=45.91.116.7:4009 , piece_id=CXYXHKMS5WYNMMVB2QYPQLJEOPU37DXOTSU4FVZM3X5SRZHCKGLQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.048864480 (72h40m43.08843759s) [noise=true , address=45.91.116.12:4226 , piece_id=VWGO3EGYPLSL4IZYA6EIAXB3TVOL2XKYXXHGYRNO43C4G6QZLEWQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.049105992 (72h40m43.088679102s) [noise=true , address=145.79.227.18:4006 , piece_id=UWKWRXKHZIVKB2LRN4KOZYHBRJBGZLB42RQFKLZBK2BHS3TH3Q6Q, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.049315873 (72h40m43.088888993s) [noise=true , address=45.91.116.8:4047 , piece_id=QZ6PXDBMTUYNBRZISIW5IV7SR5KMPQUCH55ERCO3HYJTO4RWBDKQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.049528079 (72h40m43.089101199s) [noise=true , address=45.91.116.13:4154 , piece_id=D7BYNBMB5ZTUDZI2ARH34TPPJK3NBCN6GO32CU52EMAOZCIBLYNA, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.049745325 (72h40m43.089318455s) [noise=true , address=145.79.227.14:4838 , piece_id=MSCW7ZXL4NS6UD47EULJ2WU4AE7DFGQ23MFC5RSSIUZFPTK62GPQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.050022105 (72h40m43.089595225s) [noise=true , address=45.91.116.5:4298 , piece_id=OWHDOIORT5NR3AOUWMNSBS7N3SOYWTWATZNVSTT7BHKAX4S6CHFQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.050240613 (72h40m43.089813733s) [noise=true , address=77.90.31.21:4879 , piece_id=WHOFYWMKF3LIGACF3OKZ26UPU5DY5KIVJLHHU3HYHOOH6FF6CUKQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.050457959 (72h40m43.090031079s) [noise=true , address=45.91.116.9:4263 , piece_id=YBWW5AMDJ2SAE3FRFEMFFEPJAGM5RBGGNYHYTY2Q46ARVF5B22BA, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.050660948 (72h40m43.090234068s) [noise=true , address=77.90.31.12:4590 , piece_id=SMDFG3RBL66PU5WOEWRGUSWJSZPGVTJAL74MC3ZJIDWEWXI5UUIQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:07.050861110 (72h40m43.09043423s) [noise=true , address=45.91.116.6:4974 , piece_id=UQBK6RLQRUKVUAHJFO6FMLPB45NDLPLHAMF7H2PSJICES62ACZBQ, seg_pos={0 0}, upload=63964]: Uploading piece... Sep 9 14:09:08.902400304 (72h40m44.941973424s) [upload=63964]: Next returned nil segment Sep 9 14:09:08.902415653 (72h40m44.941988773s) [upload=63964]: Waiting for error group managing segments... Sep 9 14:09:09.262283378 (72h40m45.301856498s) [noise=true , address=45.91.116.5:4298 , piece_id=OWHDOIORT5NR3AOUWMNSBS7N3SOYWTWATZNVSTT7BHKAX4S6CHFQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.272687006 (72h40m45.312260126s) [noise=true , address=45.91.116.4:4938 , piece_id=5DDNFJ4UHRX4TMTQAGJ5ZHRVTJDPQDNYCESHLVMMCFAFV7YA7WBQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.295456798 (72h40m45.335029928s) [noise=true , address=45.91.116.9:4263 , piece_id=YBWW5AMDJ2SAE3FRFEMFFEPJAGM5RBGGNYHYTY2Q46ARVF5B22BA, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.309189868 (72h40m45.348763018s) [noise=true , address=45.91.116.6:4974 , piece_id=UQBK6RLQRUKVUAHJFO6FMLPB45NDLPLHAMF7H2PSJICES62ACZBQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.323249363 (72h40m45.362822483s) [noise=true , address=45.91.116.4:4939 , piece_id=UBH4P7V2TPJYN2UFSDBP7WTIGYEF67PU7XVD7YTM77BQ56WLXJFQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.338200713 (72h40m45.377773833s) [noise=true , address=45.91.116.7:4009 , piece_id=CXYXHKMS5WYNMMVB2QYPQLJEOPU37DXOTSU4FVZM3X5SRZHCKGLQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.358306518 (72h40m45.397879638s) [noise=true , address=45.91.116.13:4154 , piece_id=D7BYNBMB5ZTUDZI2ARH34TPPJK3NBCN6GO32CU52EMAOZCIBLYNA, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.379003173 (72h40m45.418576293s) [noise=true , address=77.90.31.12:4590 , piece_id=SMDFG3RBL66PU5WOEWRGUSWJSZPGVTJAL74MC3ZJIDWEWXI5UUIQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.418394132 (72h40m45.457967252s) [noise=true , address=77.90.31.17:4772 , piece_id=GYDYAOROFLZZ6OO7CRF4I7ST6AWEUBXINYUFZUSJ6YY3BRIJC5NQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.434996573 (72h40m45.474569693s) [noise=true , address=145.79.227.18:4006 , piece_id=UWKWRXKHZIVKB2LRN4KOZYHBRJBGZLB42RQFKLZBK2BHS3TH3Q6Q, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.468825478 (72h40m45.508398598s) [noise=true , address=77.90.31.15:4699 , piece_id=IKFZF4HF5FT5XSJ7T7TFZFBYUKGVIOITX3IQVYM3KAH5S5ERQZLA, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.878894296 (72h40m45.918467406s) [noise=true , address=145.79.227.14:4838 , piece_id=MSCW7ZXL4NS6UD47EULJ2WU4AE7DFGQ23MFC5RSSIUZFPTK62GPQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.916795424 (72h40m45.956368534s) [noise=true , address=77.90.31.21:4879 , piece_id=WHOFYWMKF3LIGACF3OKZ26UPU5DY5KIVJLHHU3HYHOOH6FF6CUKQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: <nil> Sep 9 14:09:09.916832554 (72h40m45.956405714s) [seg_pos={0 0}, upload=63964]: Segment reached optimal threshold of 13 pieces. Sep 9 14:09:09.916973915 (72h40m45.956547035s) [noise=true , address=77.90.31.10:4517 , piece_id=3DO4BC44OUNOHU3GKD3S7IPOHFG5NIHUNQVJKT734TOUUZ25FVFQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: expected piece hash; context canceled; EOF Sep 9 14:09:09.917047285 (72h40m45.956620405s) [noise=true , address=45.91.116.8:4047 , piece_id=QZ6PXDBMTUYNBRZISIW5IV7SR5KMPQUCH55ERCO3HYJTO4RWBDKQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 9 14:09:09.917067744 (72h40m45.956640874s) [noise=true , address=45.91.116.12:4226 , piece_id=VWGO3EGYPLSL4IZYA6EIAXB3TVOL2XKYXXHGYRNO43C4G6QZLEWQ, seg_pos={0 0}, upload=63964]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 9 14:09:09.917085508 (72h40m45.956658628s) [seg_pos={0 0}, upload=63964]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:09:09.917176542 (72h40m45.956749702s) [upload=63964]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:09:09.917184748 (72h40m45.956757898s) [upload=63964]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:09:10.356300892 (72h40m46.395874012s) [upload=63964]: Done uploading segments... Sep 9 14:09:10.356321762 (72h40m46.395894882s) [upload=63964]: Upload finished. err: <nil> Duration: 30.002326673s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.369984644s FAIL (2025-09-09 14:09:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.370008832s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.022340262s FAIL (2025-09-09 14:09:09 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.022364248s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......X..........X............................XXXXXXX...XXX] duration: 30.003463185s FAIL (2025-09-09 14:08:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:08:26.268829277 (72h40m2.308402397s) [upload=63956]: Starting upload Sep 9 14:08:26.268911133 (72h40m2.308484264s) [upload=63956]: Done starting upload Sep 9 14:08:26.268983060 (72h40m2.308556181s) [upload=63956]: Uploading segments... Sep 9 14:08:26.269204766 (72h40m2.308777886s) [upload=63956]: Got next segment. Inline: false Sep 9 14:08:26.269270992 (72h40m2.308844122s) [upload=63956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:08:26.269277103 (72h40m2.308850223s) [upload=63956]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:08:26.527799212 (72h40m2.567372332s) [seg_pos={0 0}, upload=63956]: Begin upload segment... Sep 9 14:08:26.527847885 (72h40m2.567421005s) [seg_pos={0 0}, upload=63956]: Done begin upload segment. Sep 9 14:08:26.527869035 (72h40m2.567442166s) [noise=true , address=77.90.31.15:4697 , piece_id=RVMTBA7NUF7TP7U7ZJLHUTPABMPNEW6CS7DAQNEPRFFYX2TFYZVQ, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.527877072 (72h40m2.567450182s) [noise=true , address=45.91.116.7:4011 , piece_id=KNR6G44R6CEACGHT7CKMEK4S5SIQRXTEGBBJ3NMSDSBIGQMK4URQ, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.528182125 (72h40m2.567755245s) [noise=true , address=77.90.31.21:4878 , piece_id=3G32ZNRF4TBMBBHTCKRFCDOWDBQOU46HRCEDDDGFR6SZND7U6PPQ, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.528409841 (72h40m2.567982951s) [noise=true , address=145.79.227.17:4970 , piece_id=46P66RBLFKF3CRDZGOAZDW5NFRVBDSMQQUCG7OOHX6IRA7V7S3JA, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.528642576 (72h40m2.568215696s) [noise=true , address=45.91.116.13:4155 , piece_id=BVAETSSNS3QEMI5MEYC5BDALLBBY5HC4EJCHPCM5VFSA64D674VQ, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.528927401 (72h40m2.568500521s) [noise=true , address=45.91.116.14:4190 , piece_id=ZWZXA4PUM2PB3ACRQ2ZSONZMI2PFQOCUV2FHHRE72EKDY5WXWQAA, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.529218388 (72h40m2.568791508s) [noise=true , address=45.91.116.9:4261 , piece_id=R24RAL474Q2TBI4INT22TE6ISDXGBHR5VERM3B2VFLFOLUYSGGZA, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.529619776 (72h40m2.569192896s) [noise=true , address=145.79.227.19:4077 , piece_id=LL5SWVB5G2JKTFOLGFBV3RC4XQ6HMGI2VRTCL74NIAVGTO7G76GQ, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.529966549 (72h40m2.569539669s) [noise=true , address=77.90.31.19:4841 , piece_id=O7RURNFFRGNPAXNKGTXGGHTK6DLXAO7IMDPEVANDK37RZW3PAR4A, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.530231998 (72h40m2.569805108s) [noise=true , address=45.91.116.11:4119 , piece_id=NLQ4NOSWJNIM2TXWH7SSLF7LDFLU7KJ7INFB3QLI332OBYQ44IAA, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.530504790 (72h40m2.57007791s) [noise=true , address=145.79.227.5:4222 , piece_id=LEVNE55ZDWHS3LLEAVPLBOYQU5XABRBSXLFQMONISBGFPREPICBA, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.530764777 (72h40m2.570337897s) [noise=true , address=77.90.31.18:4805 , piece_id=WHFGX5KAD7WHA74ZDL2457KIE7QPH3JAIMROPG3A56UUZ5PYP5TQ, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.531045014 (72h40m2.570618134s) [noise=true , address=77.90.31.17:4771 , piece_id=PFUWGUPRRIQSZWHQHRYUD4JEHTSQKMRHBBODZSEPQIWOMJ34NK4A, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.531336541 (72h40m2.570909661s) [noise=true , address=145.79.227.4:4187 , piece_id=ZEZW7SADTP2IT2C3Y5I6B3CPALWA3QZRVYXFLKXERSBBHK5DM4PA, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.531410703 (72h40m2.570983823s) [noise=true , address=77.90.31.12:4589 , piece_id=2RK4R6KYK5VBXGP6SSU3GMIE35OAGRPY3VPSDF6IY5PAIF4JWTWQ, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:26.531638929 (72h40m2.571212049s) [noise=true , address=145.79.227.18:4007 , piece_id=IVV7SMKAH566C5KQGEXWOCKT7V4UL5SDBANAG5O3WTNFPSXSKJNQ, seg_pos={0 0}, upload=63956]: Uploading piece... Sep 9 14:08:28.403373318 (72h40m4.442946438s) [upload=63956]: Next returned nil segment Sep 9 14:08:28.403393576 (72h40m4.442966696s) [upload=63956]: Waiting for error group managing segments... Sep 9 14:08:28.724934138 (72h40m4.764507258s) [noise=true , address=145.79.227.4:4187 , piece_id=ZEZW7SADTP2IT2C3Y5I6B3CPALWA3QZRVYXFLKXERSBBHK5DM4PA, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:28.745951617 (72h40m4.785524737s) [noise=true , address=45.91.116.13:4155 , piece_id=BVAETSSNS3QEMI5MEYC5BDALLBBY5HC4EJCHPCM5VFSA64D674VQ, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:28.768879091 (72h40m4.808452211s) [noise=true , address=77.90.31.21:4878 , piece_id=3G32ZNRF4TBMBBHTCKRFCDOWDBQOU46HRCEDDDGFR6SZND7U6PPQ, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:28.770044562 (72h40m4.809617672s) [noise=true , address=77.90.31.12:4589 , piece_id=2RK4R6KYK5VBXGP6SSU3GMIE35OAGRPY3VPSDF6IY5PAIF4JWTWQ, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:28.772373859 (72h40m4.811947019s) [noise=true , address=45.91.116.9:4261 , piece_id=R24RAL474Q2TBI4INT22TE6ISDXGBHR5VERM3B2VFLFOLUYSGGZA, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:28.784798094 (72h40m4.824371204s) [noise=true , address=45.91.116.7:4011 , piece_id=KNR6G44R6CEACGHT7CKMEK4S5SIQRXTEGBBJ3NMSDSBIGQMK4URQ, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:28.794096608 (72h40m4.833669728s) [noise=true , address=77.90.31.15:4697 , piece_id=RVMTBA7NUF7TP7U7ZJLHUTPABMPNEW6CS7DAQNEPRFFYX2TFYZVQ, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:28.870957630 (72h40m4.91053074s) [noise=true , address=45.91.116.14:4190 , piece_id=ZWZXA4PUM2PB3ACRQ2ZSONZMI2PFQOCUV2FHHRE72EKDY5WXWQAA, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:28.902505049 (72h40m4.942078169s) [noise=true , address=77.90.31.18:4805 , piece_id=WHFGX5KAD7WHA74ZDL2457KIE7QPH3JAIMROPG3A56UUZ5PYP5TQ, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:28.906653036 (72h40m4.946226156s) [noise=true , address=77.90.31.17:4771 , piece_id=PFUWGUPRRIQSZWHQHRYUD4JEHTSQKMRHBBODZSEPQIWOMJ34NK4A, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:28.981241659 (72h40m5.020814809s) [noise=true , address=145.79.227.5:4222 , piece_id=LEVNE55ZDWHS3LLEAVPLBOYQU5XABRBSXLFQMONISBGFPREPICBA, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:29.188760689 (72h40m5.228333809s) [noise=true , address=77.90.31.19:4841 , piece_id=O7RURNFFRGNPAXNKGTXGGHTK6DLXAO7IMDPEVANDK37RZW3PAR4A, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:29.413707027 (72h40m5.453280137s) [noise=true , address=145.79.227.18:4007 , piece_id=IVV7SMKAH566C5KQGEXWOCKT7V4UL5SDBANAG5O3WTNFPSXSKJNQ, seg_pos={0 0}, upload=63956]: Done uploading piece. err: <nil> Sep 9 14:08:29.413733728 (72h40m5.453306848s) [seg_pos={0 0}, upload=63956]: Segment reached optimal threshold of 13 pieces. Sep 9 14:08:29.413976973 (72h40m5.453550093s) [noise=true , address=45.91.116.11:4119 , piece_id=NLQ4NOSWJNIM2TXWH7SSLF7LDFLU7KJ7INFB3QLI332OBYQ44IAA, seg_pos={0 0}, upload=63956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 14:08:29.414118824 (72h40m5.453691945s) [noise=true , address=145.79.227.19:4077 , piece_id=LL5SWVB5G2JKTFOLGFBV3RC4XQ6HMGI2VRTCL74NIAVGTO7G76GQ, seg_pos={0 0}, upload=63956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: write tcp 188.166.225.170:38510->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:38510->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38510->145.79.227.19:4077: use of closed network connection Sep 9 14:08:29.414174090 (72h40m5.45374721s) [noise=true , address=145.79.227.17:4970 , piece_id=46P66RBLFKF3CRDZGOAZDW5NFRVBDSMQQUCG7OOHX6IRA7V7S3JA, seg_pos={0 0}, upload=63956]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: read tcp 188.166.225.170:47762->145.79.227.17:4970: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 9 14:08:29.414210180 (72h40m5.4537833s) [seg_pos={0 0}, upload=63956]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:08:29.414292217 (72h40m5.453865337s) [upload=63956]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:08:29.414296605 (72h40m5.453869725s) [upload=63956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:08:29.729870378 (72h40m5.769443498s) [upload=63956]: Done uploading segments... Sep 9 14:08:29.729889655 (72h40m5.769462776s) [upload=63956]: Upload finished. err: <nil> Duration: 30.003488893s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.041371041s FAIL (2025-09-09 14:08:31 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.041397061s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [........X..........X............................XXXXXXX...XX] duration: 30.0022352s FAIL (2025-09-09 14:08:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:07:36.893955047 (72h39m12.933528167s) [upload=63942]: Starting upload Sep 9 14:07:36.894069667 (72h39m12.933642787s) [upload=63942]: Done starting upload Sep 9 14:07:36.894155491 (72h39m12.933728611s) [upload=63942]: Uploading segments... Sep 9 14:07:36.894297894 (72h39m12.933871014s) [upload=63942]: Got next segment. Inline: false Sep 9 14:07:36.894330356 (72h39m12.933903476s) [upload=63942]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:07:36.894334323 (72h39m12.933907443s) [upload=63942]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:07:37.454223761 (72h39m13.493796881s) [seg_pos={0 0}, upload=63942]: Begin upload segment... Sep 9 14:07:37.454273216 (72h39m13.493846336s) [seg_pos={0 0}, upload=63942]: Done begin upload segment. Sep 9 14:07:37.454306058 (72h39m13.493879178s) [noise=true , address=45.91.116.6:4973 , piece_id=UELYSYLSA7JMY7AXMEJVEBST3GXEXMITZPE6SVX4L47YZGWMIA2Q, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.454357978 (72h39m13.493931098s) [noise=true , address=45.91.116.10:4082 , piece_id=RACJCQ53AOU3XM6QUNNB6DI3MZF5SSYLDKEHDBGMRFEBHBD5S2JQ, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.454713318 (72h39m13.494286438s) [noise=true , address=45.91.116.12:4226 , piece_id=BZBMOL7SIFDNTJQORK4L6PTITPB4QKF4W2Y6Z2GZ4B74EJBQFOWQ, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.454820363 (72h39m13.494393473s) [noise=true , address=145.79.227.3:4151 , piece_id=EMX7HPP53E2QPDA2LD6OVYJM5Z6K3TCC2IKXSJAOARSDBBTUMFQQ, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.455014594 (72h39m13.494587714s) [noise=true , address=45.91.116.4:4937 , piece_id=5UYOMXDM3ENUBFGIZNAAEB4SAWUINJGUGPCVT35BSUU4QEGQWXEQ, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.455139523 (72h39m13.494712643s) [noise=true , address=45.91.116.8:4045 , piece_id=6JUZAWVLNAUB44KZSLCOVRJ6YEVMQZJBWSKHPHWRV5RWUSIVEFZA, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.455290362 (72h39m13.494863482s) [noise=true , address=77.90.31.18:4806 , piece_id=6ERFLPDKQYBJFL5A7OSBVBTZOQQLEYXSCX4LKNQCNIXTXOLL44KQ, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.455549828 (72h39m13.495122948s) [noise=true , address=145.79.227.16:4912 , piece_id=XRHTH47YJ46KZUJJROHVHN3ZGQOXCSMIEK5IP2CBELSHWE6HVICA, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.455650841 (72h39m13.495224021s) [noise=true , address=45.91.116.13:4153 , piece_id=EEJNQNOHESR2PYZ6N5JPHPMVUPYHOVT64OVOPTWZTRISIWVGBEIQ, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.455792302 (72h39m13.495365422s) [noise=true , address=45.91.116.14:4190 , piece_id=HPDS4MKF4M7NOLVUPK7UVFPI6SYJVG7NYMRFMPMPXP73LTQR5ZSQ, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.456015038 (72h39m13.495588158s) [noise=true , address=45.91.116.11:4117 , piece_id=KZH344TRTDE4GFCUZXSLKEZLAFIBKVW224ZWNAXUG34S7M7QCV6A, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.456076126 (72h39m13.495649246s) [noise=true , address=77.90.31.10:4519 , piece_id=F7FDG4MBQUIZ4IH5B5O6TUVXPK6IY3LQH5SGKR7GJHAWHO5BDKLQ, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.456238206 (72h39m13.495811326s) [noise=true , address=77.90.31.21:4878 , piece_id=WHF4NXO52ZWB7LR54WAJ4PABQ35UPVCNG7C3KYP47VVS5INPU6AQ, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.456592434 (72h39m13.496165564s) [noise=true , address=77.90.31.21:4877 , piece_id=H552NGK7UAHFUYCMMGBE7LTL373ME2WXTU2SC3MRXS3TMHAWYGMA, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.457094784 (72h39m13.496667905s) [noise=true , address=77.90.31.17:4770 , piece_id=3XYAWKMHPCO3RHV7Q4BFR7JPCAUR46MTCYESJFQWSN5KLL666LJA, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:37.457424726 (72h39m13.496997846s) [noise=true , address=77.90.31.13:4626 , piece_id=KQNOTQ34I4KWBO22TO2FIRTKUVBBEA5BRHLQZCPIGJXLQHO6J7LA, seg_pos={0 0}, upload=63942]: Uploading piece... Sep 9 14:07:39.285220544 (72h39m15.324793664s) [upload=63942]: Next returned nil segment Sep 9 14:07:39.285246413 (72h39m15.324819534s) [upload=63942]: Waiting for error group managing segments... Sep 9 14:07:39.668264728 (72h39m15.707837848s) [noise=true , address=45.91.116.14:4190 , piece_id=HPDS4MKF4M7NOLVUPK7UVFPI6SYJVG7NYMRFMPMPXP73LTQR5ZSQ, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:39.677947888 (72h39m15.717520998s) [noise=true , address=77.90.31.17:4770 , piece_id=3XYAWKMHPCO3RHV7Q4BFR7JPCAUR46MTCYESJFQWSN5KLL666LJA, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:39.688779386 (72h39m15.728352506s) [noise=true , address=45.91.116.12:4226 , piece_id=BZBMOL7SIFDNTJQORK4L6PTITPB4QKF4W2Y6Z2GZ4B74EJBQFOWQ, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:39.695119748 (72h39m15.734692868s) [noise=true , address=77.90.31.18:4806 , piece_id=6ERFLPDKQYBJFL5A7OSBVBTZOQQLEYXSCX4LKNQCNIXTXOLL44KQ, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:39.732511051 (72h39m15.772084171s) [noise=true , address=45.91.116.6:4973 , piece_id=UELYSYLSA7JMY7AXMEJVEBST3GXEXMITZPE6SVX4L47YZGWMIA2Q, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:39.745351843 (72h39m15.784924993s) [noise=true , address=45.91.116.4:4937 , piece_id=5UYOMXDM3ENUBFGIZNAAEB4SAWUINJGUGPCVT35BSUU4QEGQWXEQ, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:39.793121224 (72h39m15.832694344s) [noise=true , address=145.79.227.3:4151 , piece_id=EMX7HPP53E2QPDA2LD6OVYJM5Z6K3TCC2IKXSJAOARSDBBTUMFQQ, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:39.810282665 (72h39m15.849855785s) [noise=true , address=77.90.31.13:4626 , piece_id=KQNOTQ34I4KWBO22TO2FIRTKUVBBEA5BRHLQZCPIGJXLQHO6J7LA, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:39.812187250 (72h39m15.85176037s) [noise=true , address=77.90.31.21:4878 , piece_id=WHF4NXO52ZWB7LR54WAJ4PABQ35UPVCNG7C3KYP47VVS5INPU6AQ, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:39.832847907 (72h39m15.872421027s) [noise=true , address=77.90.31.21:4877 , piece_id=H552NGK7UAHFUYCMMGBE7LTL373ME2WXTU2SC3MRXS3TMHAWYGMA, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:40.012548333 (72h39m16.052121463s) [noise=true , address=45.91.116.8:4045 , piece_id=6JUZAWVLNAUB44KZSLCOVRJ6YEVMQZJBWSKHPHWRV5RWUSIVEFZA, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:40.068636453 (72h39m16.108209583s) [noise=true , address=77.90.31.10:4519 , piece_id=F7FDG4MBQUIZ4IH5B5O6TUVXPK6IY3LQH5SGKR7GJHAWHO5BDKLQ, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:40.456420298 (72h39m16.495993418s) [noise=true , address=45.91.116.11:4117 , piece_id=KZH344TRTDE4GFCUZXSLKEZLAFIBKVW224ZWNAXUG34S7M7QCV6A, seg_pos={0 0}, upload=63942]: Done uploading piece. err: <nil> Sep 9 14:07:40.456446288 (72h39m16.496019408s) [seg_pos={0 0}, upload=63942]: Segment reached optimal threshold of 13 pieces. Sep 9 14:07:40.456552280 (72h39m16.496125401s) [noise=true , address=45.91.116.10:4082 , piece_id=RACJCQ53AOU3XM6QUNNB6DI3MZF5SSYLDKEHDBGMRFEBHBD5S2JQ, seg_pos={0 0}, upload=63942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF Sep 9 14:07:40.456611724 (72h39m16.496184834s) [noise=true , address=145.79.227.16:4912 , piece_id=XRHTH47YJ46KZUJJROHVHN3ZGQOXCSMIEK5IP2CBELSHWE6HVICA, seg_pos={0 0}, upload=63942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR): protocol: expected piece hash; context canceled; EOF Sep 9 14:07:40.456638395 (72h39m16.496211505s) [noise=true , address=45.91.116.13:4153 , piece_id=EEJNQNOHESR2PYZ6N5JPHPMVUPYHOVT64OVOPTWZTRISIWVGBEIQ, seg_pos={0 0}, upload=63942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: write tcp 188.166.225.170:49700->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:49700->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49700->45.91.116.13:4153: use of closed network connection Sep 9 14:07:40.456659175 (72h39m16.496232295s) [seg_pos={0 0}, upload=63942]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:07:40.456718458 (72h39m16.496291578s) [upload=63942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:07:40.456722737 (72h39m16.496295857s) [upload=63942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:07:40.838596902 (72h39m16.878170022s) [upload=63942]: Done uploading segments... Sep 9 14:07:40.838615738 (72h39m16.878188858s) [upload=63942]: Upload finished. err: <nil> Duration: 30.002257892s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.539957814s FAIL (2025-09-09 14:07:50 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.539989423s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [.........X..........X............................XXXXXXX...X] duration: 30.001252275s FAIL (2025-09-09 14:07:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:06:54.461648011 (72h38m30.501221131s) [upload=63933]: Starting upload Sep 9 14:06:54.461747652 (72h38m30.501320772s) [upload=63933]: Done starting upload Sep 9 14:06:54.461837714 (72h38m30.501410834s) [upload=63933]: Uploading segments... Sep 9 14:06:54.462192052 (72h38m30.501765173s) [upload=63933]: Got next segment. Inline: false Sep 9 14:06:54.462226859 (72h38m30.501799979s) [upload=63933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:06:54.462233321 (72h38m30.501806441s) [upload=63933]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:06:54.704998118 (72h38m30.744571238s) [seg_pos={0 0}, upload=63933]: Begin upload segment... Sep 9 14:06:54.705044166 (72h38m30.744617286s) [seg_pos={0 0}, upload=63933]: Done begin upload segment. Sep 9 14:06:54.705065005 (72h38m30.744638125s) [noise=true , address=77.90.31.19:4843 , piece_id=JNQ63G2M72GGGFEXV37D47VRMPHNB5KGC72DO7WEER4FNGMHDT4A, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.705122576 (72h38m30.744695706s) [noise=true , address=45.91.116.8:4047 , piece_id=IQYMN4PYTZT7PXOO3JLZJQMKZYRBGCWG6QSSRBGJCKREBME3S6IA, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.705427550 (72h38m30.74500067s) [noise=true , address=77.90.31.14:4662 , piece_id=HKZLZ3IDJRX3L7JBR76ZNYC5CPQK3L2EO4MLIX4UKCKFES3KDJ4A, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.705759164 (72h38m30.745332294s) [noise=true , address=77.90.31.12:4590 , piece_id=ZK2H6QLM5NLW44QKC3L5Z4HWIS2WAJKB2NTMYY7OXT3DBLHWD3YA, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.705770075 (72h38m30.745343195s) [noise=true , address=45.91.116.6:4974 , piece_id=E4XP6BGKXKLXNCHKETI2ZPDA2K6BKYMGC6GJPVCYXAPZ3XVNRG7Q, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.706120816 (72h38m30.745693936s) [noise=true , address=145.79.227.18:4006 , piece_id=6EUF4UHBZA3Y2NAZUOU3ZI4J47X5JC6SQXAGIC44CKCVW2OUJCTA, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.706258930 (72h38m30.74583205s) [noise=true , address=145.79.227.13:4803 , piece_id=WJMTBD7WBSD7LWOPGFTZPMGQNFD4K6G7KLPWNYST37VF6ZQB223A, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.706363581 (72h38m30.745936701s) [noise=true , address=77.90.31.17:4771 , piece_id=PCM2D2ASHMNHJC3ZVD6OHUGCRFUSPDUMA6HJKTGY2X5Y7FXCRWGA, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.706594413 (72h38m30.746167533s) [noise=true , address=77.90.31.13:4628 , piece_id=5S3WCORMIRM7JA3ETLUAYB2XBC42QJSQYBVXRRAE2ATGXJMUFVKA, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.706628979 (72h38m30.746202099s) [noise=true , address=45.91.116.13:4153 , piece_id=H3LMKH7WMLS47DWZEXR6SMRV37VY7HW5A65VAASAZCJWXEPTXXSQ, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.706961254 (72h38m30.746534374s) [noise=true , address=45.91.116.14:4190 , piece_id=4MIKMK66RFD2F557FXDGXY3DUYFACBF4O277QGQIC2A4SAGVEPNA, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.707515014 (72h38m30.747088124s) [noise=true , address=145.79.227.3:4150 , piece_id=YUYGDEA7JCWRXCXNGORGDSYFXQYFUSLYZFB5ED7FYMZII77BNB4A, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.707792656 (72h38m30.747365786s) [noise=true , address=45.91.116.7:4011 , piece_id=SUDQYWWPFT6E3KUQMHJMIKTW3JDRGKHBBTLDFUGNUN77DB5CQ42Q, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.707872689 (72h38m30.747445809s) [noise=true , address=77.90.31.16:4734 , piece_id=HNIUP2IGOXRA5UGQVGSHFQEAWR5EXWFD7G5FNJS7TYCPC3SZ2VGA, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.708227718 (72h38m30.747800848s) [noise=true , address=45.91.116.11:4118 , piece_id=YRZTDXCHECS4EYSQHAM2M6G57YPLLVDXOWIKYUULJ3ZJCTA42OWA, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:54.708552860 (72h38m30.74812598s) [noise=true , address=45.91.116.6:4975 , piece_id=42PXKASWX2DXA4GOCEU465UP42L6VAI6MTGYMTGLIUV5BYPNXO4A, seg_pos={0 0}, upload=63933]: Uploading piece... Sep 9 14:06:56.480162559 (72h38m32.519735689s) [upload=63933]: Next returned nil segment Sep 9 14:06:56.480185373 (72h38m32.519758493s) [upload=63933]: Waiting for error group managing segments... Sep 9 14:06:56.857617589 (72h38m32.897190709s) [noise=true , address=145.79.227.18:4006 , piece_id=6EUF4UHBZA3Y2NAZUOU3ZI4J47X5JC6SQXAGIC44CKCVW2OUJCTA, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:56.888992910 (72h38m32.92856603s) [noise=true , address=77.90.31.19:4843 , piece_id=JNQ63G2M72GGGFEXV37D47VRMPHNB5KGC72DO7WEER4FNGMHDT4A, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:56.922787208 (72h38m32.962360328s) [noise=true , address=45.91.116.7:4011 , piece_id=SUDQYWWPFT6E3KUQMHJMIKTW3JDRGKHBBTLDFUGNUN77DB5CQ42Q, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:56.930165006 (72h38m32.969738126s) [noise=true , address=77.90.31.13:4628 , piece_id=5S3WCORMIRM7JA3ETLUAYB2XBC42QJSQYBVXRRAE2ATGXJMUFVKA, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:56.940512377 (72h38m32.980085497s) [noise=true , address=77.90.31.12:4590 , piece_id=ZK2H6QLM5NLW44QKC3L5Z4HWIS2WAJKB2NTMYY7OXT3DBLHWD3YA, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:56.950332629 (72h38m32.989905749s) [noise=true , address=45.91.116.8:4047 , piece_id=IQYMN4PYTZT7PXOO3JLZJQMKZYRBGCWG6QSSRBGJCKREBME3S6IA, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:56.963931773 (72h38m33.003504893s) [noise=true , address=45.91.116.6:4975 , piece_id=42PXKASWX2DXA4GOCEU465UP42L6VAI6MTGYMTGLIUV5BYPNXO4A, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:56.986671648 (72h38m33.026244768s) [noise=true , address=45.91.116.6:4974 , piece_id=E4XP6BGKXKLXNCHKETI2ZPDA2K6BKYMGC6GJPVCYXAPZ3XVNRG7Q, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:56.994270258 (72h38m33.033843378s) [noise=true , address=45.91.116.11:4118 , piece_id=YRZTDXCHECS4EYSQHAM2M6G57YPLLVDXOWIKYUULJ3ZJCTA42OWA, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:57.024807985 (72h38m33.064381105s) [noise=true , address=45.91.116.14:4190 , piece_id=4MIKMK66RFD2F557FXDGXY3DUYFACBF4O277QGQIC2A4SAGVEPNA, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:57.053527342 (72h38m33.093100462s) [noise=true , address=77.90.31.14:4662 , piece_id=HKZLZ3IDJRX3L7JBR76ZNYC5CPQK3L2EO4MLIX4UKCKFES3KDJ4A, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:57.061993374 (72h38m33.101566494s) [noise=true , address=77.90.31.17:4771 , piece_id=PCM2D2ASHMNHJC3ZVD6OHUGCRFUSPDUMA6HJKTGY2X5Y7FXCRWGA, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:57.113084962 (72h38m33.152658082s) [noise=true , address=145.79.227.13:4803 , piece_id=WJMTBD7WBSD7LWOPGFTZPMGQNFD4K6G7KLPWNYST37VF6ZQB223A, seg_pos={0 0}, upload=63933]: Done uploading piece. err: <nil> Sep 9 14:06:57.113109689 (72h38m33.152682809s) [seg_pos={0 0}, upload=63933]: Segment reached optimal threshold of 13 pieces. Sep 9 14:06:57.113232866 (72h38m33.152805986s) [noise=true , address=77.90.31.16:4734 , piece_id=HNIUP2IGOXRA5UGQVGSHFQEAWR5EXWFD7G5FNJS7TYCPC3SZ2VGA, seg_pos={0 0}, upload=63933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Sep 9 14:06:57.113286749 (72h38m33.152859879s) [noise=true , address=45.91.116.13:4153 , piece_id=H3LMKH7WMLS47DWZEXR6SMRV37VY7HW5A65VAASAZCJWXEPTXXSQ, seg_pos={0 0}, upload=63933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 9 14:06:57.113319191 (72h38m33.152892311s) [noise=true , address=145.79.227.3:4150 , piece_id=YUYGDEA7JCWRXCXNGORGDSYFXQYFUSLYZFB5ED7FYMZII77BNB4A, seg_pos={0 0}, upload=63933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK): protocol: expected piece hash; context canceled; EOF Sep 9 14:06:57.113334340 (72h38m33.15290746s) [seg_pos={0 0}, upload=63933]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:06:57.113424733 (72h38m33.152997853s) [upload=63933]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:06:57.113432487 (72h38m33.153005607s) [upload=63933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:06:57.409129455 (72h38m33.448702575s) [upload=63933]: Done uploading segments... Sep 9 14:06:57.409149653 (72h38m33.448722773s) [upload=63933]: Upload finished. err: <nil> Duration: 30.001274076s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.787417105s FAIL (2025-09-09 14:06:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.787447032s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.008010086s FAIL (2025-09-09 14:06:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.008039804s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [..........X..........X............................XXXXXXX...] duration: 25.168674354s FAIL (2025-09-09 14:06:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:03:23.430367668 (72h34m59.469940788s) [upload=63880]: Starting upload Sep 9 14:03:23.430456208 (72h34m59.470029328s) [upload=63880]: Done starting upload Sep 9 14:03:23.430624229 (72h34m59.470197349s) [upload=63880]: Uploading segments... Sep 9 14:03:23.430729431 (72h34m59.470302551s) [upload=63880]: Got next segment. Inline: false Sep 9 14:03:23.430779235 (72h34m59.470352355s) [upload=63880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:03:23.430784276 (72h34m59.470357396s) [upload=63880]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:03:23.919415934 (72h34m59.958989054s) [seg_pos={0 0}, upload=63880]: Begin upload segment... Sep 9 14:03:23.919459438 (72h34m59.959032558s) [seg_pos={0 0}, upload=63880]: Done begin upload segment. Sep 9 14:03:23.919480028 (72h34m59.959053148s) [noise=true , address=77.90.31.19:4842 , piece_id=H7O3NAD3AQIMNMLBYTF4YNXUIBRRXC53UMPP7CBF6EFNBJGHYRCA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.919483695 (72h34m59.959056815s) [noise=true , address=45.91.116.9:4261 , piece_id=DDT3MOLYNEFTTPBCLIS2B3IAC6JIINHN7KBXZ2NIV4VLMERQFVHA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.919859133 (72h34m59.959432253s) [noise=true , address=45.91.116.5:4298 , piece_id=YFJIKMLMW6JMLHRWDOLK6O7UVAWXSCOK5NK3LXQ4LZOMBQCS2UXA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920160239 (72h34m59.95973339s) [noise=true , address=77.90.31.15:4698 , piece_id=N3FLHGFP75MC7RRE6X3IVYGROZULB22FVKVWUQHLUUZC3DFJUVTA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920524747 (72h34m59.960097867s) [noise=true , address=77.90.31.12:4590 , piece_id=QTD3VSJBR5TXY3SOYMXIKWA6AS2REETDDEOHNJMAASEO7APL4TKQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920787991 (72h34m59.960361111s) [noise=true , address=45.91.116.11:4118 , piece_id=EVCBRDF6RWJ2FZWKSGSQCC6G3QNOFSCXKMHERI65TEXBXJOTCH3A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921018832 (72h34m59.960591952s) [noise=true , address=145.79.227.3:4149 , piece_id=QWZ4IW5SF3D2Y2ORZVQ6OZGXXY4QR6DAGJ7TKVUPXYWOWFEUXTDA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921257950 (72h34m59.96083107s) [noise=true , address=145.79.227.18:4007 , piece_id=Z33LDBFX6E5DM32XEXYHHYZPO5UTV2AUBBVES3KVBFJO7TLPJE2A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921479984 (72h34m59.961053105s) [noise=true , address=77.90.31.10:4517 , piece_id=HMY5B2UR3UIPFELXL7O4HBY75WC4HQ4VMFI7N3IBEVNL6QVMXU6Q, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921733951 (72h34m59.961307071s) [noise=true , address=145.79.227.11:4729 , piece_id=4NF425XIA7UY5SKBTUCR644KVHRTPFVOSCI7WTSMQ3QDJROT7BMQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922021361 (72h34m59.961594481s) [noise=true , address=77.90.31.16:4733 , piece_id=5IRJASMCQAQ3KXIE3FU5LKLNQCYLQTZYGGUMFQAI37ZBUX2BDPWA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922190344 (72h34m59.961763464s) [noise=true , address=77.90.31.18:4805 , piece_id=5D3V75SL2QYIJ42LC7M5LQLI2CWFTCKRHGY7GYRXH3JNI2OBGTFQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922509084 (72h34m59.962082204s) [noise=true , address=77.90.31.14:4662 , piece_id=EBBPX5OCOC2WN2JZJW46233HZAEMGBHD64RCOBOGWIGGEIEWFBNQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922798328 (72h34m59.962371448s) [noise=true , address=45.91.116.12:4226 , piece_id=4RLK4HTLDNACW654G3COKL63ZMOKQGZ4MUKDDMWQFUHMRIU4VNTQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.923361154 (72h34m59.962934274s) [noise=true , address=45.91.116.14:4190 , piece_id=KMT5UW5KXK3UOW5CWRDF5EX2W4WG3HX7K6T6D7C6CB4HM5OACVIA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.923677490 (72h34m59.96325061s) [noise=true , address=45.91.116.7:4011 , piece_id=4TGDK2T7WVU42BKLARCZJ55AY2QVW3GH6CUB2XDAFWUDRM5XN74A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:25.799347428 (72h35m1.838920548s) [upload=63880]: Next returned nil segment Sep 9 14:03:25.799395450 (72h35m1.83896858s) [upload=63880]: Waiting for error group managing segments... Sep 9 14:03:26.099685323 (72h35m2.139258453s) [noise=true , address=45.91.116.14:4190 , piece_id=KMT5UW5KXK3UOW5CWRDF5EX2W4WG3HX7K6T6D7C6CB4HM5OACVIA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.134439587 (72h35m2.174012708s) [noise=true , address=77.90.31.14:4662 , piece_id=EBBPX5OCOC2WN2JZJW46233HZAEMGBHD64RCOBOGWIGGEIEWFBNQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.159288017 (72h35m2.198861137s) [noise=true , address=45.91.116.7:4011 , piece_id=4TGDK2T7WVU42BKLARCZJ55AY2QVW3GH6CUB2XDAFWUDRM5XN74A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.165550190 (72h35m2.20512331s) [noise=true , address=45.91.116.12:4226 , piece_id=4RLK4HTLDNACW654G3COKL63ZMOKQGZ4MUKDDMWQFUHMRIU4VNTQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.173585936 (72h35m2.213159057s) [noise=true , address=77.90.31.16:4733 , piece_id=5IRJASMCQAQ3KXIE3FU5LKLNQCYLQTZYGGUMFQAI37ZBUX2BDPWA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.185117684 (72h35m2.224690804s) [noise=true , address=77.90.31.10:4517 , piece_id=HMY5B2UR3UIPFELXL7O4HBY75WC4HQ4VMFI7N3IBEVNL6QVMXU6Q, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.217716856 (72h35m2.257289976s) [noise=true , address=77.90.31.18:4805 , piece_id=5D3V75SL2QYIJ42LC7M5LQLI2CWFTCKRHGY7GYRXH3JNI2OBGTFQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.221286848 (72h35m2.260859968s) [noise=true , address=145.79.227.18:4007 , piece_id=Z33LDBFX6E5DM32XEXYHHYZPO5UTV2AUBBVES3KVBFJO7TLPJE2A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.252802766 (72h35m2.292375886s) [noise=true , address=45.91.116.9:4261 , piece_id=DDT3MOLYNEFTTPBCLIS2B3IAC6JIINHN7KBXZ2NIV4VLMERQFVHA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.307641014 (72h35m2.347214144s) [noise=true , address=45.91.116.11:4118 , piece_id=EVCBRDF6RWJ2FZWKSGSQCC6G3QNOFSCXKMHERI65TEXBXJOTCH3A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.382424769 (72h35m2.42199789s) [noise=true , address=145.79.227.3:4149 , piece_id=QWZ4IW5SF3D2Y2ORZVQ6OZGXXY4QR6DAGJ7TKVUPXYWOWFEUXTDA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.491730035 (72h35m2.531303155s) [noise=true , address=77.90.31.15:4698 , piece_id=N3FLHGFP75MC7RRE6X3IVYGROZULB22FVKVWUQHLUUZC3DFJUVTA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.530767497 (72h35m2.570340618s) [noise=true , address=77.90.31.19:4842 , piece_id=H7O3NAD3AQIMNMLBYTF4YNXUIBRRXC53UMPP7CBF6EFNBJGHYRCA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.530798397 (72h35m2.570371517s) [seg_pos={0 0}, upload=63880]: Segment reached optimal threshold of 13 pieces. Sep 9 14:03:26.530960898 (72h35m2.570534018s) [noise=true , address=145.79.227.11:4729 , piece_id=4NF425XIA7UY5SKBTUCR644KVHRTPFVOSCI7WTSMQ3QDJROT7BMQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Sep 9 14:03:26.531027785 (72h35m2.570600905s) [noise=true , address=77.90.31.12:4590 , piece_id=QTD3VSJBR5TXY3SOYMXIKWA6AS2REETDDEOHNJMAASEO7APL4TKQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 14:03:26.531067370 (72h35m2.57064049s) [noise=true , address=45.91.116.5:4298 , piece_id=YFJIKMLMW6JMLHRWDOLK6O7UVAWXSCOK5NK3LXQ4LZOMBQCS2UXA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection Sep 9 14:03:26.531082690 (72h35m2.57065581s) [seg_pos={0 0}, upload=63880]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:03:26.531175427 (72h35m2.570748547s) [upload=63880]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:03:26.531179646 (72h35m2.570752766s) [upload=63880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:03:27.094215606 (72h35m3.133788726s) [upload=63880]: Done uploading segments... Sep 9 14:03:27.094234352 (72h35m3.133807472s) [upload=63880]: Upload finished. err: <nil> Duration: 25.168694583s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...........X..........X............................XXXXXXX..] duration: 27.40596033s FAIL (2025-09-09 14:05:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:03:23.430367668 (72h34m59.469940788s) [upload=63880]: Starting upload Sep 9 14:03:23.430456208 (72h34m59.470029328s) [upload=63880]: Done starting upload Sep 9 14:03:23.430624229 (72h34m59.470197349s) [upload=63880]: Uploading segments... Sep 9 14:03:23.430729431 (72h34m59.470302551s) [upload=63880]: Got next segment. Inline: false Sep 9 14:03:23.430779235 (72h34m59.470352355s) [upload=63880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:03:23.430784276 (72h34m59.470357396s) [upload=63880]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:03:23.919415934 (72h34m59.958989054s) [seg_pos={0 0}, upload=63880]: Begin upload segment... Sep 9 14:03:23.919459438 (72h34m59.959032558s) [seg_pos={0 0}, upload=63880]: Done begin upload segment. Sep 9 14:03:23.919480028 (72h34m59.959053148s) [noise=true , address=77.90.31.19:4842 , piece_id=H7O3NAD3AQIMNMLBYTF4YNXUIBRRXC53UMPP7CBF6EFNBJGHYRCA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.919483695 (72h34m59.959056815s) [noise=true , address=45.91.116.9:4261 , piece_id=DDT3MOLYNEFTTPBCLIS2B3IAC6JIINHN7KBXZ2NIV4VLMERQFVHA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.919859133 (72h34m59.959432253s) [noise=true , address=45.91.116.5:4298 , piece_id=YFJIKMLMW6JMLHRWDOLK6O7UVAWXSCOK5NK3LXQ4LZOMBQCS2UXA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920160239 (72h34m59.95973339s) [noise=true , address=77.90.31.15:4698 , piece_id=N3FLHGFP75MC7RRE6X3IVYGROZULB22FVKVWUQHLUUZC3DFJUVTA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920524747 (72h34m59.960097867s) [noise=true , address=77.90.31.12:4590 , piece_id=QTD3VSJBR5TXY3SOYMXIKWA6AS2REETDDEOHNJMAASEO7APL4TKQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920787991 (72h34m59.960361111s) [noise=true , address=45.91.116.11:4118 , piece_id=EVCBRDF6RWJ2FZWKSGSQCC6G3QNOFSCXKMHERI65TEXBXJOTCH3A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921018832 (72h34m59.960591952s) [noise=true , address=145.79.227.3:4149 , piece_id=QWZ4IW5SF3D2Y2ORZVQ6OZGXXY4QR6DAGJ7TKVUPXYWOWFEUXTDA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921257950 (72h34m59.96083107s) [noise=true , address=145.79.227.18:4007 , piece_id=Z33LDBFX6E5DM32XEXYHHYZPO5UTV2AUBBVES3KVBFJO7TLPJE2A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921479984 (72h34m59.961053105s) [noise=true , address=77.90.31.10:4517 , piece_id=HMY5B2UR3UIPFELXL7O4HBY75WC4HQ4VMFI7N3IBEVNL6QVMXU6Q, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921733951 (72h34m59.961307071s) [noise=true , address=145.79.227.11:4729 , piece_id=4NF425XIA7UY5SKBTUCR644KVHRTPFVOSCI7WTSMQ3QDJROT7BMQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922021361 (72h34m59.961594481s) [noise=true , address=77.90.31.16:4733 , piece_id=5IRJASMCQAQ3KXIE3FU5LKLNQCYLQTZYGGUMFQAI37ZBUX2BDPWA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922190344 (72h34m59.961763464s) [noise=true , address=77.90.31.18:4805 , piece_id=5D3V75SL2QYIJ42LC7M5LQLI2CWFTCKRHGY7GYRXH3JNI2OBGTFQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922509084 (72h34m59.962082204s) [noise=true , address=77.90.31.14:4662 , piece_id=EBBPX5OCOC2WN2JZJW46233HZAEMGBHD64RCOBOGWIGGEIEWFBNQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922798328 (72h34m59.962371448s) [noise=true , address=45.91.116.12:4226 , piece_id=4RLK4HTLDNACW654G3COKL63ZMOKQGZ4MUKDDMWQFUHMRIU4VNTQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.923361154 (72h34m59.962934274s) [noise=true , address=45.91.116.14:4190 , piece_id=KMT5UW5KXK3UOW5CWRDF5EX2W4WG3HX7K6T6D7C6CB4HM5OACVIA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.923677490 (72h34m59.96325061s) [noise=true , address=45.91.116.7:4011 , piece_id=4TGDK2T7WVU42BKLARCZJ55AY2QVW3GH6CUB2XDAFWUDRM5XN74A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:25.799347428 (72h35m1.838920548s) [upload=63880]: Next returned nil segment Sep 9 14:03:25.799395450 (72h35m1.83896858s) [upload=63880]: Waiting for error group managing segments... Sep 9 14:03:26.099685323 (72h35m2.139258453s) [noise=true , address=45.91.116.14:4190 , piece_id=KMT5UW5KXK3UOW5CWRDF5EX2W4WG3HX7K6T6D7C6CB4HM5OACVIA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.134439587 (72h35m2.174012708s) [noise=true , address=77.90.31.14:4662 , piece_id=EBBPX5OCOC2WN2JZJW46233HZAEMGBHD64RCOBOGWIGGEIEWFBNQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.159288017 (72h35m2.198861137s) [noise=true , address=45.91.116.7:4011 , piece_id=4TGDK2T7WVU42BKLARCZJ55AY2QVW3GH6CUB2XDAFWUDRM5XN74A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.165550190 (72h35m2.20512331s) [noise=true , address=45.91.116.12:4226 , piece_id=4RLK4HTLDNACW654G3COKL63ZMOKQGZ4MUKDDMWQFUHMRIU4VNTQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.173585936 (72h35m2.213159057s) [noise=true , address=77.90.31.16:4733 , piece_id=5IRJASMCQAQ3KXIE3FU5LKLNQCYLQTZYGGUMFQAI37ZBUX2BDPWA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.185117684 (72h35m2.224690804s) [noise=true , address=77.90.31.10:4517 , piece_id=HMY5B2UR3UIPFELXL7O4HBY75WC4HQ4VMFI7N3IBEVNL6QVMXU6Q, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.217716856 (72h35m2.257289976s) [noise=true , address=77.90.31.18:4805 , piece_id=5D3V75SL2QYIJ42LC7M5LQLI2CWFTCKRHGY7GYRXH3JNI2OBGTFQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.221286848 (72h35m2.260859968s) [noise=true , address=145.79.227.18:4007 , piece_id=Z33LDBFX6E5DM32XEXYHHYZPO5UTV2AUBBVES3KVBFJO7TLPJE2A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.252802766 (72h35m2.292375886s) [noise=true , address=45.91.116.9:4261 , piece_id=DDT3MOLYNEFTTPBCLIS2B3IAC6JIINHN7KBXZ2NIV4VLMERQFVHA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.307641014 (72h35m2.347214144s) [noise=true , address=45.91.116.11:4118 , piece_id=EVCBRDF6RWJ2FZWKSGSQCC6G3QNOFSCXKMHERI65TEXBXJOTCH3A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.382424769 (72h35m2.42199789s) [noise=true , address=145.79.227.3:4149 , piece_id=QWZ4IW5SF3D2Y2ORZVQ6OZGXXY4QR6DAGJ7TKVUPXYWOWFEUXTDA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.491730035 (72h35m2.531303155s) [noise=true , address=77.90.31.15:4698 , piece_id=N3FLHGFP75MC7RRE6X3IVYGROZULB22FVKVWUQHLUUZC3DFJUVTA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.530767497 (72h35m2.570340618s) [noise=true , address=77.90.31.19:4842 , piece_id=H7O3NAD3AQIMNMLBYTF4YNXUIBRRXC53UMPP7CBF6EFNBJGHYRCA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.530798397 (72h35m2.570371517s) [seg_pos={0 0}, upload=63880]: Segment reached optimal threshold of 13 pieces. Sep 9 14:03:26.530960898 (72h35m2.570534018s) [noise=true , address=145.79.227.11:4729 , piece_id=4NF425XIA7UY5SKBTUCR644KVHRTPFVOSCI7WTSMQ3QDJROT7BMQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Sep 9 14:03:26.531027785 (72h35m2.570600905s) [noise=true , address=77.90.31.12:4590 , piece_id=QTD3VSJBR5TXY3SOYMXIKWA6AS2REETDDEOHNJMAASEO7APL4TKQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 14:03:26.531067370 (72h35m2.57064049s) [noise=true , address=45.91.116.5:4298 , piece_id=YFJIKMLMW6JMLHRWDOLK6O7UVAWXSCOK5NK3LXQ4LZOMBQCS2UXA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection Sep 9 14:03:26.531082690 (72h35m2.57065581s) [seg_pos={0 0}, upload=63880]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:03:26.531175427 (72h35m2.570748547s) [upload=63880]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:03:26.531179646 (72h35m2.570752766s) [upload=63880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:03:27.094215606 (72h35m3.133788726s) [upload=63880]: Done uploading segments... Sep 9 14:03:27.094234352 (72h35m3.133807472s) [upload=63880]: Upload finished. err: <nil> Duration: 27.405988073s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.327138239s FAIL (2025-09-09 14:05:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.327165269s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.721177317s FAIL (2025-09-09 14:05:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.721210982s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [............X..........X............................XXXXXXX.] duration: 26.677954673s FAIL (2025-09-09 14:05:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:03:23.430367668 (72h34m59.469940788s) [upload=63880]: Starting upload Sep 9 14:03:23.430456208 (72h34m59.470029328s) [upload=63880]: Done starting upload Sep 9 14:03:23.430624229 (72h34m59.470197349s) [upload=63880]: Uploading segments... Sep 9 14:03:23.430729431 (72h34m59.470302551s) [upload=63880]: Got next segment. Inline: false Sep 9 14:03:23.430779235 (72h34m59.470352355s) [upload=63880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:03:23.430784276 (72h34m59.470357396s) [upload=63880]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:03:23.919415934 (72h34m59.958989054s) [seg_pos={0 0}, upload=63880]: Begin upload segment... Sep 9 14:03:23.919459438 (72h34m59.959032558s) [seg_pos={0 0}, upload=63880]: Done begin upload segment. Sep 9 14:03:23.919480028 (72h34m59.959053148s) [noise=true , address=77.90.31.19:4842 , piece_id=H7O3NAD3AQIMNMLBYTF4YNXUIBRRXC53UMPP7CBF6EFNBJGHYRCA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.919483695 (72h34m59.959056815s) [noise=true , address=45.91.116.9:4261 , piece_id=DDT3MOLYNEFTTPBCLIS2B3IAC6JIINHN7KBXZ2NIV4VLMERQFVHA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.919859133 (72h34m59.959432253s) [noise=true , address=45.91.116.5:4298 , piece_id=YFJIKMLMW6JMLHRWDOLK6O7UVAWXSCOK5NK3LXQ4LZOMBQCS2UXA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920160239 (72h34m59.95973339s) [noise=true , address=77.90.31.15:4698 , piece_id=N3FLHGFP75MC7RRE6X3IVYGROZULB22FVKVWUQHLUUZC3DFJUVTA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920524747 (72h34m59.960097867s) [noise=true , address=77.90.31.12:4590 , piece_id=QTD3VSJBR5TXY3SOYMXIKWA6AS2REETDDEOHNJMAASEO7APL4TKQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920787991 (72h34m59.960361111s) [noise=true , address=45.91.116.11:4118 , piece_id=EVCBRDF6RWJ2FZWKSGSQCC6G3QNOFSCXKMHERI65TEXBXJOTCH3A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921018832 (72h34m59.960591952s) [noise=true , address=145.79.227.3:4149 , piece_id=QWZ4IW5SF3D2Y2ORZVQ6OZGXXY4QR6DAGJ7TKVUPXYWOWFEUXTDA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921257950 (72h34m59.96083107s) [noise=true , address=145.79.227.18:4007 , piece_id=Z33LDBFX6E5DM32XEXYHHYZPO5UTV2AUBBVES3KVBFJO7TLPJE2A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921479984 (72h34m59.961053105s) [noise=true , address=77.90.31.10:4517 , piece_id=HMY5B2UR3UIPFELXL7O4HBY75WC4HQ4VMFI7N3IBEVNL6QVMXU6Q, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921733951 (72h34m59.961307071s) [noise=true , address=145.79.227.11:4729 , piece_id=4NF425XIA7UY5SKBTUCR644KVHRTPFVOSCI7WTSMQ3QDJROT7BMQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922021361 (72h34m59.961594481s) [noise=true , address=77.90.31.16:4733 , piece_id=5IRJASMCQAQ3KXIE3FU5LKLNQCYLQTZYGGUMFQAI37ZBUX2BDPWA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922190344 (72h34m59.961763464s) [noise=true , address=77.90.31.18:4805 , piece_id=5D3V75SL2QYIJ42LC7M5LQLI2CWFTCKRHGY7GYRXH3JNI2OBGTFQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922509084 (72h34m59.962082204s) [noise=true , address=77.90.31.14:4662 , piece_id=EBBPX5OCOC2WN2JZJW46233HZAEMGBHD64RCOBOGWIGGEIEWFBNQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922798328 (72h34m59.962371448s) [noise=true , address=45.91.116.12:4226 , piece_id=4RLK4HTLDNACW654G3COKL63ZMOKQGZ4MUKDDMWQFUHMRIU4VNTQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.923361154 (72h34m59.962934274s) [noise=true , address=45.91.116.14:4190 , piece_id=KMT5UW5KXK3UOW5CWRDF5EX2W4WG3HX7K6T6D7C6CB4HM5OACVIA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.923677490 (72h34m59.96325061s) [noise=true , address=45.91.116.7:4011 , piece_id=4TGDK2T7WVU42BKLARCZJ55AY2QVW3GH6CUB2XDAFWUDRM5XN74A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:25.799347428 (72h35m1.838920548s) [upload=63880]: Next returned nil segment Sep 9 14:03:25.799395450 (72h35m1.83896858s) [upload=63880]: Waiting for error group managing segments... Sep 9 14:03:26.099685323 (72h35m2.139258453s) [noise=true , address=45.91.116.14:4190 , piece_id=KMT5UW5KXK3UOW5CWRDF5EX2W4WG3HX7K6T6D7C6CB4HM5OACVIA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.134439587 (72h35m2.174012708s) [noise=true , address=77.90.31.14:4662 , piece_id=EBBPX5OCOC2WN2JZJW46233HZAEMGBHD64RCOBOGWIGGEIEWFBNQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.159288017 (72h35m2.198861137s) [noise=true , address=45.91.116.7:4011 , piece_id=4TGDK2T7WVU42BKLARCZJ55AY2QVW3GH6CUB2XDAFWUDRM5XN74A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.165550190 (72h35m2.20512331s) [noise=true , address=45.91.116.12:4226 , piece_id=4RLK4HTLDNACW654G3COKL63ZMOKQGZ4MUKDDMWQFUHMRIU4VNTQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.173585936 (72h35m2.213159057s) [noise=true , address=77.90.31.16:4733 , piece_id=5IRJASMCQAQ3KXIE3FU5LKLNQCYLQTZYGGUMFQAI37ZBUX2BDPWA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.185117684 (72h35m2.224690804s) [noise=true , address=77.90.31.10:4517 , piece_id=HMY5B2UR3UIPFELXL7O4HBY75WC4HQ4VMFI7N3IBEVNL6QVMXU6Q, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.217716856 (72h35m2.257289976s) [noise=true , address=77.90.31.18:4805 , piece_id=5D3V75SL2QYIJ42LC7M5LQLI2CWFTCKRHGY7GYRXH3JNI2OBGTFQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.221286848 (72h35m2.260859968s) [noise=true , address=145.79.227.18:4007 , piece_id=Z33LDBFX6E5DM32XEXYHHYZPO5UTV2AUBBVES3KVBFJO7TLPJE2A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.252802766 (72h35m2.292375886s) [noise=true , address=45.91.116.9:4261 , piece_id=DDT3MOLYNEFTTPBCLIS2B3IAC6JIINHN7KBXZ2NIV4VLMERQFVHA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.307641014 (72h35m2.347214144s) [noise=true , address=45.91.116.11:4118 , piece_id=EVCBRDF6RWJ2FZWKSGSQCC6G3QNOFSCXKMHERI65TEXBXJOTCH3A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.382424769 (72h35m2.42199789s) [noise=true , address=145.79.227.3:4149 , piece_id=QWZ4IW5SF3D2Y2ORZVQ6OZGXXY4QR6DAGJ7TKVUPXYWOWFEUXTDA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.491730035 (72h35m2.531303155s) [noise=true , address=77.90.31.15:4698 , piece_id=N3FLHGFP75MC7RRE6X3IVYGROZULB22FVKVWUQHLUUZC3DFJUVTA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.530767497 (72h35m2.570340618s) [noise=true , address=77.90.31.19:4842 , piece_id=H7O3NAD3AQIMNMLBYTF4YNXUIBRRXC53UMPP7CBF6EFNBJGHYRCA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.530798397 (72h35m2.570371517s) [seg_pos={0 0}, upload=63880]: Segment reached optimal threshold of 13 pieces. Sep 9 14:03:26.530960898 (72h35m2.570534018s) [noise=true , address=145.79.227.11:4729 , piece_id=4NF425XIA7UY5SKBTUCR644KVHRTPFVOSCI7WTSMQ3QDJROT7BMQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Sep 9 14:03:26.531027785 (72h35m2.570600905s) [noise=true , address=77.90.31.12:4590 , piece_id=QTD3VSJBR5TXY3SOYMXIKWA6AS2REETDDEOHNJMAASEO7APL4TKQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 14:03:26.531067370 (72h35m2.57064049s) [noise=true , address=45.91.116.5:4298 , piece_id=YFJIKMLMW6JMLHRWDOLK6O7UVAWXSCOK5NK3LXQ4LZOMBQCS2UXA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection Sep 9 14:03:26.531082690 (72h35m2.57065581s) [seg_pos={0 0}, upload=63880]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:03:26.531175427 (72h35m2.570748547s) [upload=63880]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:03:26.531179646 (72h35m2.570752766s) [upload=63880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:03:27.094215606 (72h35m3.133788726s) [upload=63880]: Done uploading segments... Sep 9 14:03:27.094234352 (72h35m3.133807472s) [upload=63880]: Upload finished. err: <nil> Duration: 26.677987676s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.442361775s FAIL (2025-09-09 14:04:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.442386944s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.480771416s FAIL (2025-09-09 14:04:01 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.480804389s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.............X..........X............................XXXXXXX] duration: 30.002472638s FAIL (2025-09-09 14:03:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:03:23.430367668 (72h34m59.469940788s) [upload=63880]: Starting upload Sep 9 14:03:23.430456208 (72h34m59.470029328s) [upload=63880]: Done starting upload Sep 9 14:03:23.430624229 (72h34m59.470197349s) [upload=63880]: Uploading segments... Sep 9 14:03:23.430729431 (72h34m59.470302551s) [upload=63880]: Got next segment. Inline: false Sep 9 14:03:23.430779235 (72h34m59.470352355s) [upload=63880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:03:23.430784276 (72h34m59.470357396s) [upload=63880]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:03:23.919415934 (72h34m59.958989054s) [seg_pos={0 0}, upload=63880]: Begin upload segment... Sep 9 14:03:23.919459438 (72h34m59.959032558s) [seg_pos={0 0}, upload=63880]: Done begin upload segment. Sep 9 14:03:23.919480028 (72h34m59.959053148s) [noise=true , address=77.90.31.19:4842 , piece_id=H7O3NAD3AQIMNMLBYTF4YNXUIBRRXC53UMPP7CBF6EFNBJGHYRCA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.919483695 (72h34m59.959056815s) [noise=true , address=45.91.116.9:4261 , piece_id=DDT3MOLYNEFTTPBCLIS2B3IAC6JIINHN7KBXZ2NIV4VLMERQFVHA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.919859133 (72h34m59.959432253s) [noise=true , address=45.91.116.5:4298 , piece_id=YFJIKMLMW6JMLHRWDOLK6O7UVAWXSCOK5NK3LXQ4LZOMBQCS2UXA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920160239 (72h34m59.95973339s) [noise=true , address=77.90.31.15:4698 , piece_id=N3FLHGFP75MC7RRE6X3IVYGROZULB22FVKVWUQHLUUZC3DFJUVTA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920524747 (72h34m59.960097867s) [noise=true , address=77.90.31.12:4590 , piece_id=QTD3VSJBR5TXY3SOYMXIKWA6AS2REETDDEOHNJMAASEO7APL4TKQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.920787991 (72h34m59.960361111s) [noise=true , address=45.91.116.11:4118 , piece_id=EVCBRDF6RWJ2FZWKSGSQCC6G3QNOFSCXKMHERI65TEXBXJOTCH3A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921018832 (72h34m59.960591952s) [noise=true , address=145.79.227.3:4149 , piece_id=QWZ4IW5SF3D2Y2ORZVQ6OZGXXY4QR6DAGJ7TKVUPXYWOWFEUXTDA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921257950 (72h34m59.96083107s) [noise=true , address=145.79.227.18:4007 , piece_id=Z33LDBFX6E5DM32XEXYHHYZPO5UTV2AUBBVES3KVBFJO7TLPJE2A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921479984 (72h34m59.961053105s) [noise=true , address=77.90.31.10:4517 , piece_id=HMY5B2UR3UIPFELXL7O4HBY75WC4HQ4VMFI7N3IBEVNL6QVMXU6Q, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.921733951 (72h34m59.961307071s) [noise=true , address=145.79.227.11:4729 , piece_id=4NF425XIA7UY5SKBTUCR644KVHRTPFVOSCI7WTSMQ3QDJROT7BMQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922021361 (72h34m59.961594481s) [noise=true , address=77.90.31.16:4733 , piece_id=5IRJASMCQAQ3KXIE3FU5LKLNQCYLQTZYGGUMFQAI37ZBUX2BDPWA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922190344 (72h34m59.961763464s) [noise=true , address=77.90.31.18:4805 , piece_id=5D3V75SL2QYIJ42LC7M5LQLI2CWFTCKRHGY7GYRXH3JNI2OBGTFQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922509084 (72h34m59.962082204s) [noise=true , address=77.90.31.14:4662 , piece_id=EBBPX5OCOC2WN2JZJW46233HZAEMGBHD64RCOBOGWIGGEIEWFBNQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.922798328 (72h34m59.962371448s) [noise=true , address=45.91.116.12:4226 , piece_id=4RLK4HTLDNACW654G3COKL63ZMOKQGZ4MUKDDMWQFUHMRIU4VNTQ, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.923361154 (72h34m59.962934274s) [noise=true , address=45.91.116.14:4190 , piece_id=KMT5UW5KXK3UOW5CWRDF5EX2W4WG3HX7K6T6D7C6CB4HM5OACVIA, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:23.923677490 (72h34m59.96325061s) [noise=true , address=45.91.116.7:4011 , piece_id=4TGDK2T7WVU42BKLARCZJ55AY2QVW3GH6CUB2XDAFWUDRM5XN74A, seg_pos={0 0}, upload=63880]: Uploading piece... Sep 9 14:03:25.799347428 (72h35m1.838920548s) [upload=63880]: Next returned nil segment Sep 9 14:03:25.799395450 (72h35m1.83896858s) [upload=63880]: Waiting for error group managing segments... Sep 9 14:03:26.099685323 (72h35m2.139258453s) [noise=true , address=45.91.116.14:4190 , piece_id=KMT5UW5KXK3UOW5CWRDF5EX2W4WG3HX7K6T6D7C6CB4HM5OACVIA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.134439587 (72h35m2.174012708s) [noise=true , address=77.90.31.14:4662 , piece_id=EBBPX5OCOC2WN2JZJW46233HZAEMGBHD64RCOBOGWIGGEIEWFBNQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.159288017 (72h35m2.198861137s) [noise=true , address=45.91.116.7:4011 , piece_id=4TGDK2T7WVU42BKLARCZJ55AY2QVW3GH6CUB2XDAFWUDRM5XN74A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.165550190 (72h35m2.20512331s) [noise=true , address=45.91.116.12:4226 , piece_id=4RLK4HTLDNACW654G3COKL63ZMOKQGZ4MUKDDMWQFUHMRIU4VNTQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.173585936 (72h35m2.213159057s) [noise=true , address=77.90.31.16:4733 , piece_id=5IRJASMCQAQ3KXIE3FU5LKLNQCYLQTZYGGUMFQAI37ZBUX2BDPWA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.185117684 (72h35m2.224690804s) [noise=true , address=77.90.31.10:4517 , piece_id=HMY5B2UR3UIPFELXL7O4HBY75WC4HQ4VMFI7N3IBEVNL6QVMXU6Q, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.217716856 (72h35m2.257289976s) [noise=true , address=77.90.31.18:4805 , piece_id=5D3V75SL2QYIJ42LC7M5LQLI2CWFTCKRHGY7GYRXH3JNI2OBGTFQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.221286848 (72h35m2.260859968s) [noise=true , address=145.79.227.18:4007 , piece_id=Z33LDBFX6E5DM32XEXYHHYZPO5UTV2AUBBVES3KVBFJO7TLPJE2A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.252802766 (72h35m2.292375886s) [noise=true , address=45.91.116.9:4261 , piece_id=DDT3MOLYNEFTTPBCLIS2B3IAC6JIINHN7KBXZ2NIV4VLMERQFVHA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.307641014 (72h35m2.347214144s) [noise=true , address=45.91.116.11:4118 , piece_id=EVCBRDF6RWJ2FZWKSGSQCC6G3QNOFSCXKMHERI65TEXBXJOTCH3A, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.382424769 (72h35m2.42199789s) [noise=true , address=145.79.227.3:4149 , piece_id=QWZ4IW5SF3D2Y2ORZVQ6OZGXXY4QR6DAGJ7TKVUPXYWOWFEUXTDA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.491730035 (72h35m2.531303155s) [noise=true , address=77.90.31.15:4698 , piece_id=N3FLHGFP75MC7RRE6X3IVYGROZULB22FVKVWUQHLUUZC3DFJUVTA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.530767497 (72h35m2.570340618s) [noise=true , address=77.90.31.19:4842 , piece_id=H7O3NAD3AQIMNMLBYTF4YNXUIBRRXC53UMPP7CBF6EFNBJGHYRCA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: <nil> Sep 9 14:03:26.530798397 (72h35m2.570371517s) [seg_pos={0 0}, upload=63880]: Segment reached optimal threshold of 13 pieces. Sep 9 14:03:26.530960898 (72h35m2.570534018s) [noise=true , address=145.79.227.11:4729 , piece_id=4NF425XIA7UY5SKBTUCR644KVHRTPFVOSCI7WTSMQ3QDJROT7BMQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Sep 9 14:03:26.531027785 (72h35m2.570600905s) [noise=true , address=77.90.31.12:4590 , piece_id=QTD3VSJBR5TXY3SOYMXIKWA6AS2REETDDEOHNJMAASEO7APL4TKQ, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 9 14:03:26.531067370 (72h35m2.57064049s) [noise=true , address=45.91.116.5:4298 , piece_id=YFJIKMLMW6JMLHRWDOLK6O7UVAWXSCOK5NK3LXQ4LZOMBQCS2UXA, seg_pos={0 0}, upload=63880]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35122->45.91.116.5:4298: use of closed network connection Sep 9 14:03:26.531082690 (72h35m2.57065581s) [seg_pos={0 0}, upload=63880]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:03:26.531175427 (72h35m2.570748547s) [upload=63880]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:03:26.531179646 (72h35m2.570752766s) [upload=63880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:03:27.094215606 (72h35m3.133788726s) [upload=63880]: Done uploading segments... Sep 9 14:03:27.094234352 (72h35m3.133807472s) [upload=63880]: Upload finished. err: <nil> Duration: 30.002487685s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.424711159s FAIL (2025-09-09 14:03:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.424750785s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [..............X..........X............................XXXXXX] duration: 30.002213329s FAIL (2025-09-09 14:03:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:02:53.252805342 (72h34m29.292378462s) [upload=63871]: Starting upload Sep 9 14:02:53.252892831 (72h34m29.292465951s) [upload=63871]: Done starting upload Sep 9 14:02:53.253148169 (72h34m29.292721289s) [upload=63871]: Uploading segments... Sep 9 14:02:53.253306292 (72h34m29.292879412s) [upload=63871]: Got next segment. Inline: false Sep 9 14:02:53.253341348 (72h34m29.292914468s) [upload=63871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:02:53.253358351 (72h34m29.292931471s) [upload=63871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:02:53.533832945 (72h34m29.573406085s) [seg_pos={0 0}, upload=63871]: Begin upload segment... Sep 9 14:02:53.533892428 (72h34m29.573465548s) [seg_pos={0 0}, upload=63871]: Done begin upload segment. Sep 9 14:02:53.533984023 (72h34m29.573557143s) [noise=true , address=145.79.227.17:4969 , piece_id=K67YSOQPAGFH65JCJPDBGJHD3YDFRLN4EC7VMLE5CKQRBAJEB3IQ, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.534047105 (72h34m29.573620235s) [noise=true , address=45.91.116.13:4155 , piece_id=ENQ3HGTXBFQPPR4ZWJ77MA5IKGND2JRTW3WIPZB33HLGT3E76THA, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.534530820 (72h34m29.57410395s) [noise=true , address=77.90.31.19:4842 , piece_id=NZRRVMWXWIFYBOLSWYYU53TU2VLQKGLEGI5GWDBKS5OH476WDJXQ, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.534735151 (72h34m29.574308271s) [noise=true , address=45.91.116.9:4262 , piece_id=5I2NFOMUTQSLUBH7K2RQT42QZ7RU3PSIZZ67QYSWISE534OEYPWQ, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.534937157 (72h34m29.574510277s) [noise=true , address=45.91.116.6:4974 , piece_id=ADIZGDK6Y5ZHJIPHJGMRCX27NHCUUPDYKHF46BNK62HXF7SPJSVQ, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.535841167 (72h34m29.575414297s) [noise=true , address=77.90.31.14:4661 , piece_id=GLITOJDXMZFGT6SHADHYITI55ZDONK23ZMWZDQUPQC4PUQ5F2BVA, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.536282362 (72h34m29.575855482s) [noise=true , address=45.91.116.14:4190 , piece_id=4ELBSAD4JUPC46OMT2VHFWOJSWI6EIDTSXMTR5N5X35YHPXHGFUQ, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.536920252 (72h34m29.576493382s) [noise=true , address=45.91.116.9:4263 , piece_id=RNYEY7TRZQ4HVTBDYKHTQ7IENOZZIXYUD3GULCPEGIBMY3EDYATA, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.538438789 (72h34m29.578011919s) [noise=true , address=45.91.116.8:4047 , piece_id=Z4K7H45RLFCX3SD5YUKJ2LBUAWR3HG6MW56BBTKUK6JP5YSNCGMQ, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.539528293 (72h34m29.579101424s) [noise=true , address=77.90.31.21:4877 , piece_id=VB5Z2D6HZSUVCLJBVW3CIWZGCBBBIDSTBQ6LPSOIGJIDC4FSDYSA, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.540633889 (72h34m29.580207039s) [noise=true , address=77.90.31.10:4519 , piece_id=36DBWPDKBKQFAND44C3C3OXR54QLQAH5BL243GRMIRYB2APES6IA, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.541233446 (72h34m29.580806566s) [noise=true , address=45.91.116.4:4938 , piece_id=3UVPR7A5OPMJDCTSKL7OMJT2XZSFRQU4PFWBYQEZSCQDUW6CVNXA, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.542213351 (72h34m29.581786471s) [noise=true , address=145.79.227.16:4909 , piece_id=2SITRPQGXJTXI5RIPJ3WVK6QY5MGCQL4GGXFUTA6LXVJ6LX7DIQQ, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.543402457 (72h34m29.582975587s) [noise=true , address=77.90.31.10:4517 , piece_id=23QSFAIWFFUWKXJEQU6BQ4HKMQRW7TN7OG4FZP7GGE43OIZ6PQBQ, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.544079241 (72h34m29.583652361s) [noise=true , address=45.91.116.13:4154 , piece_id=N35JFMCL7U63DZCCB3642NKHM4JI2RSKKO7FZQZZWQEUEVTEQLZQ, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:53.545149230 (72h34m29.58472235s) [noise=true , address=77.90.31.14:4662 , piece_id=XNYB2FMMEBF7QHK6K2FINNENVOUOYSTH77ERNLHJBRVAHYICVRNQ, seg_pos={0 0}, upload=63871]: Uploading piece... Sep 9 14:02:55.275090671 (72h34m31.314663791s) [upload=63871]: Next returned nil segment Sep 9 14:02:55.275110409 (72h34m31.314683539s) [upload=63871]: Waiting for error group managing segments... Sep 9 14:02:55.566187331 (72h34m31.605760451s) [noise=true , address=145.79.227.16:4909 , piece_id=2SITRPQGXJTXI5RIPJ3WVK6QY5MGCQL4GGXFUTA6LXVJ6LX7DIQQ, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.768804107 (72h34m31.808377227s) [noise=true , address=45.91.116.8:4047 , piece_id=Z4K7H45RLFCX3SD5YUKJ2LBUAWR3HG6MW56BBTKUK6JP5YSNCGMQ, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.770246547 (72h34m31.809819667s) [noise=true , address=77.90.31.10:4517 , piece_id=23QSFAIWFFUWKXJEQU6BQ4HKMQRW7TN7OG4FZP7GGE43OIZ6PQBQ, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.786358097 (72h34m31.825931217s) [noise=true , address=77.90.31.19:4842 , piece_id=NZRRVMWXWIFYBOLSWYYU53TU2VLQKGLEGI5GWDBKS5OH476WDJXQ, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.788142913 (72h34m31.827716023s) [noise=true , address=45.91.116.14:4190 , piece_id=4ELBSAD4JUPC46OMT2VHFWOJSWI6EIDTSXMTR5N5X35YHPXHGFUQ, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.790933824 (72h34m31.830506944s) [noise=true , address=45.91.116.13:4155 , piece_id=ENQ3HGTXBFQPPR4ZWJ77MA5IKGND2JRTW3WIPZB33HLGT3E76THA, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.795444655 (72h34m31.835017765s) [noise=true , address=77.90.31.10:4519 , piece_id=36DBWPDKBKQFAND44C3C3OXR54QLQAH5BL243GRMIRYB2APES6IA, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.813746488 (72h34m31.853319608s) [noise=true , address=77.90.31.21:4877 , piece_id=VB5Z2D6HZSUVCLJBVW3CIWZGCBBBIDSTBQ6LPSOIGJIDC4FSDYSA, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.814851923 (72h34m31.854425043s) [noise=true , address=45.91.116.4:4938 , piece_id=3UVPR7A5OPMJDCTSKL7OMJT2XZSFRQU4PFWBYQEZSCQDUW6CVNXA, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.819571865 (72h34m31.859144985s) [noise=true , address=45.91.116.9:4262 , piece_id=5I2NFOMUTQSLUBH7K2RQT42QZ7RU3PSIZZ67QYSWISE534OEYPWQ, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.850594109 (72h34m31.890167229s) [noise=true , address=45.91.116.6:4974 , piece_id=ADIZGDK6Y5ZHJIPHJGMRCX27NHCUUPDYKHF46BNK62HXF7SPJSVQ, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.856044439 (72h34m31.895617549s) [noise=true , address=145.79.227.17:4969 , piece_id=K67YSOQPAGFH65JCJPDBGJHD3YDFRLN4EC7VMLE5CKQRBAJEB3IQ, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.874468726 (72h34m31.914041846s) [noise=true , address=77.90.31.14:4661 , piece_id=GLITOJDXMZFGT6SHADHYITI55ZDONK23ZMWZDQUPQC4PUQ5F2BVA, seg_pos={0 0}, upload=63871]: Done uploading piece. err: <nil> Sep 9 14:02:55.874495356 (72h34m31.914068477s) [seg_pos={0 0}, upload=63871]: Segment reached optimal threshold of 13 pieces. Sep 9 14:02:55.874631006 (72h34m31.914204126s) [noise=true , address=77.90.31.14:4662 , piece_id=XNYB2FMMEBF7QHK6K2FINNENVOUOYSTH77ERNLHJBRVAHYICVRNQ, seg_pos={0 0}, upload=63871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: expected piece hash; context canceled; EOF Sep 9 14:02:55.874744864 (72h34m31.914317984s) [noise=true , address=45.91.116.9:4263 , piece_id=RNYEY7TRZQ4HVTBDYKHTQ7IENOZZIXYUD3GULCPEGIBMY3EDYATA, seg_pos={0 0}, upload=63871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Sep 9 14:02:55.874786093 (72h34m31.914359213s) [noise=true , address=45.91.116.13:4154 , piece_id=N35JFMCL7U63DZCCB3642NKHM4JI2RSKKO7FZQZZWQEUEVTEQLZQ, seg_pos={0 0}, upload=63871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: write tcp 188.166.225.170:59720->45.91.116.13:4154: use of closed network connection; write tcp 188.166.225.170:59720->45.91.116.13:4154: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->45.91.116.13:4154: use of closed network connection Sep 9 14:02:55.874798577 (72h34m31.914371697s) [seg_pos={0 0}, upload=63871]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:02:55.874890142 (72h34m31.914463252s) [upload=63871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:02:55.874894330 (72h34m31.91446745s) [upload=63871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:02:56.243032827 (72h34m32.282605997s) [upload=63871]: Done uploading segments... Sep 9 14:02:56.243055902 (72h34m32.282629022s) [upload=63871]: Upload finished. err: <nil> Duration: 30.002232024s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.437459154s FAIL (2025-09-09 14:03:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.437498639s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.684422242s FAIL (2025-09-09 14:02:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.684439335s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m49.694230694s FAIL (2025-09-09 14:02:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1m49.694263717s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [...............X..........X............................XXXXX] duration: 30.00148692s FAIL (2025-09-09 14:02:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:01:39.974113951 (72h33m16.013687072s) [upload=63856]: Starting upload Sep 9 14:01:39.974174187 (72h33m16.013747307s) [upload=63856]: Done starting upload Sep 9 14:01:39.974269940 (72h33m16.01384306s) [upload=63856]: Uploading segments... Sep 9 14:01:39.974400090 (72h33m16.01397321s) [upload=63856]: Got next segment. Inline: false Sep 9 14:01:39.974432171 (72h33m16.014005291s) [upload=63856]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:01:39.974437160 (72h33m16.01401028s) [upload=63856]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:01:40.486083092 (72h33m16.525656212s) [seg_pos={0 0}, upload=63856]: Begin upload segment... Sep 9 14:01:40.486131003 (72h33m16.525704123s) [seg_pos={0 0}, upload=63856]: Done begin upload segment. Sep 9 14:01:40.486156312 (72h33m16.525729432s) [noise=true , address=77.90.31.16:4735 , piece_id=UP4OXGQHNEYINCG2ZHVRZUUWT6K75UUTCPI5ASOV4FA4OER2IZBA, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.486166932 (72h33m16.525740053s) [noise=true , address=45.91.116.14:4191 , piece_id=KDBBQXA65JEAZYMMMZ6YQHJRNSTS3KROXBT7MJHX6F4LH72JK62A, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.486513114 (72h33m16.526086234s) [noise=true , address=77.90.31.16:4733 , piece_id=WPCUMCJ7FHPLKSK3AQ3PHEGPJIR4PT563TZBLTHQK7YIHMWBWK3A, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.486539715 (72h33m16.526112835s) [noise=true , address=77.90.31.19:4842 , piece_id=4X6OMVQOWJCKJKZK4GZIO7ESVFK7SLVTPQRACBVZW5FLWGVKC4OQ, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.486768644 (72h33m16.526341764s) [noise=true , address=145.79.227.15:4875 , piece_id=GUPUVQVOR46PTZNZA2SDCBKWLZO72IFI52U4KDLH4RES3EV3NO3Q, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.486851172 (72h33m16.526424292s) [noise=true , address=45.91.116.7:4009 , piece_id=JQ5WHZWLCKASSW62W6AXBCBVHUX4WYGBC22LAT7TOCRZT7IZRGDA, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.487019464 (72h33m16.526592584s) [noise=true , address=45.91.116.10:4081 , piece_id=FMH44USODY2WNE7DYXCWSX2KVVMXLWIPQUI2AGOPNKT7DYJ7SETQ, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.487244213 (72h33m16.526817334s) [noise=true , address=77.90.31.15:4697 , piece_id=YGNOVZ7RHUT4TJHTGXXEZN6BKFYM3OGLUT4CUPMRM6BN24VBKWRA, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.487272908 (72h33m16.526846028s) [noise=true , address=45.91.116.5:4298 , piece_id=YYDX6XXVAQ2UOERHA5ATUSXREUHKL5HGL3GR4KZH5MHD57DRTPVA, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.487525812 (72h33m16.527098932s) [noise=true , address=45.91.116.9:4263 , piece_id=UGDKN22WFGJMF737WEL4GMIL5RFSKAQ4JDPCLNVPBWLUFK4NPL3A, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.487658336 (72h33m16.527231456s) [noise=true , address=77.90.31.12:4592 , piece_id=3UJLB756FIDIYBMEUI4QONDOWK6QLAMDMHEUF4R6NCQKVIM7F7ZA, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.487772694 (72h33m16.527345814s) [noise=true , address=45.91.116.10:4082 , piece_id=7S7TT3QTWUB5AAOQVQZOGM6UV6NRGHXIXTSR5DAKTFGZN3YUFHHQ, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.487965383 (72h33m16.527538503s) [noise=true , address=145.79.227.19:4077 , piece_id=JZK5MDADFWC7FKMXHLBZ7RAYBMDR2GQ5U3AHUL7BTCLVBJDRNILQ, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.488488876 (72h33m16.528061996s) [noise=true , address=45.91.116.7:4010 , piece_id=G2SAS4LC2GDE46UPJTKO6HVHJ7KDORYIXCK5XNNSUAKR463BFBSA, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.489661348 (72h33m16.529234468s) [noise=true , address=77.90.31.10:4517 , piece_id=5JGZQLZ6GEM4P3GHMVS3Y5MP7HBYZAO55K3FZ6RODBQDQ77LKTRQ, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:40.489819822 (72h33m16.529392942s) [noise=true , address=77.90.31.15:4698 , piece_id=TGKDUJPL332SWA3OIFDFQV77YT4AEHJKC55DRCJVUHRMMOLWCITA, seg_pos={0 0}, upload=63856]: Uploading piece... Sep 9 14:01:42.269160202 (72h33m18.308733322s) [upload=63856]: Next returned nil segment Sep 9 14:01:42.269177715 (72h33m18.308750835s) [upload=63856]: Waiting for error group managing segments... Sep 9 14:01:42.609834744 (72h33m18.649407884s) [noise=true , address=145.79.227.19:4077 , piece_id=JZK5MDADFWC7FKMXHLBZ7RAYBMDR2GQ5U3AHUL7BTCLVBJDRNILQ, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:42.716406069 (72h33m18.755979189s) [noise=true , address=77.90.31.10:4517 , piece_id=5JGZQLZ6GEM4P3GHMVS3Y5MP7HBYZAO55K3FZ6RODBQDQ77LKTRQ, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:42.728055591 (72h33m18.767628721s) [noise=true , address=77.90.31.16:4735 , piece_id=UP4OXGQHNEYINCG2ZHVRZUUWT6K75UUTCPI5ASOV4FA4OER2IZBA, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:42.731404440 (72h33m18.77097756s) [noise=true , address=45.91.116.7:4010 , piece_id=G2SAS4LC2GDE46UPJTKO6HVHJ7KDORYIXCK5XNNSUAKR463BFBSA, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:42.735516758 (72h33m18.775089888s) [noise=true , address=45.91.116.14:4191 , piece_id=KDBBQXA65JEAZYMMMZ6YQHJRNSTS3KROXBT7MJHX6F4LH72JK62A, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:42.761082932 (72h33m18.800656052s) [noise=true , address=45.91.116.9:4263 , piece_id=UGDKN22WFGJMF737WEL4GMIL5RFSKAQ4JDPCLNVPBWLUFK4NPL3A, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:42.768998179 (72h33m18.808571299s) [noise=true , address=77.90.31.16:4733 , piece_id=WPCUMCJ7FHPLKSK3AQ3PHEGPJIR4PT563TZBLTHQK7YIHMWBWK3A, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:42.771127854 (72h33m18.810700974s) [noise=true , address=45.91.116.5:4298 , piece_id=YYDX6XXVAQ2UOERHA5ATUSXREUHKL5HGL3GR4KZH5MHD57DRTPVA, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:42.780160649 (72h33m18.819733769s) [noise=true , address=77.90.31.19:4842 , piece_id=4X6OMVQOWJCKJKZK4GZIO7ESVFK7SLVTPQRACBVZW5FLWGVKC4OQ, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:42.856927399 (72h33m18.896500529s) [noise=true , address=145.79.227.15:4875 , piece_id=GUPUVQVOR46PTZNZA2SDCBKWLZO72IFI52U4KDLH4RES3EV3NO3Q, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:42.912267087 (72h33m18.951840247s) [noise=true , address=45.91.116.10:4082 , piece_id=7S7TT3QTWUB5AAOQVQZOGM6UV6NRGHXIXTSR5DAKTFGZN3YUFHHQ, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:43.066236181 (72h33m19.105809321s) [noise=true , address=77.90.31.12:4592 , piece_id=3UJLB756FIDIYBMEUI4QONDOWK6QLAMDMHEUF4R6NCQKVIM7F7ZA, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:43.573056337 (72h33m19.612629457s) [noise=true , address=77.90.31.15:4698 , piece_id=TGKDUJPL332SWA3OIFDFQV77YT4AEHJKC55DRCJVUHRMMOLWCITA, seg_pos={0 0}, upload=63856]: Done uploading piece. err: <nil> Sep 9 14:01:43.573100061 (72h33m19.612673191s) [seg_pos={0 0}, upload=63856]: Segment reached optimal threshold of 13 pieces. Sep 9 14:01:43.573250589 (72h33m19.612823709s) [noise=true , address=77.90.31.15:4697 , piece_id=YGNOVZ7RHUT4TJHTGXXEZN6BKFYM3OGLUT4CUPMRM6BN24VBKWRA, seg_pos={0 0}, upload=63856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Sep 9 14:01:43.573267972 (72h33m19.612841092s) [noise=true , address=45.91.116.7:4009 , piece_id=JQ5WHZWLCKASSW62W6AXBCBVHUX4WYGBC22LAT7TOCRZT7IZRGDA, seg_pos={0 0}, upload=63856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF Sep 9 14:01:43.573350150 (72h33m19.61292327s) [noise=true , address=45.91.116.10:4081 , piece_id=FMH44USODY2WNE7DYXCWSX2KVVMXLWIPQUI2AGOPNKT7DYJ7SETQ, seg_pos={0 0}, upload=63856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Sep 9 14:01:43.573399094 (72h33m19.612972214s) [seg_pos={0 0}, upload=63856]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:01:43.573488554 (72h33m19.613061765s) [upload=63856]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:01:43.573496099 (72h33m19.613069249s) [upload=63856]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:01:43.941588517 (72h33m19.981161637s) [upload=63856]: Done uploading segments... Sep 9 14:01:43.941609556 (72h33m19.981182676s) [upload=63856]: Upload finished. err: <nil> Duration: 30.001509753s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [................X..........X............................XXXX] duration: 30.002287064s FAIL (2025-09-09 14:00:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 14:00:29.650073947 (72h32m5.689647077s) [upload=63839]: Starting upload Sep 9 14:00:29.650161915 (72h32m5.689735035s) [upload=63839]: Done starting upload Sep 9 14:00:29.650438735 (72h32m5.690011856s) [upload=63839]: Uploading segments... Sep 9 14:00:29.650571929 (72h32m5.69014505s) [upload=63839]: Got next segment. Inline: false Sep 9 14:00:29.651323939 (72h32m5.690897069s) [upload=63839]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 14:00:29.651333827 (72h32m5.690906958s) [upload=63839]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 14:00:30.154741675 (72h32m6.194314795s) [seg_pos={0 0}, upload=63839]: Begin upload segment... Sep 9 14:00:30.154782142 (72h32m6.194355262s) [seg_pos={0 0}, upload=63839]: Done begin upload segment. Sep 9 14:00:30.154810116 (72h32m6.194383236s) [noise=true , address=77.90.31.16:4734 , piece_id=LRGGT2PFAW6ZTFEU7NF4N52ANHFD5PHV4DZJKWXLS26JE6GC7APQ, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.155176597 (72h32m6.194749728s) [noise=true , address=77.90.31.10:4517 , piece_id=4LCXEBL47HW34JHV6XNMSTOLZJYDV4VJT5363JHLBKOTDG3HG24A, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.155530755 (72h32m6.195103875s) [noise=true , address=45.91.116.13:4155 , piece_id=JBBEZDHLCOE4Z7L2OGLO4ILKC6QRJXWWNOIGLULBZZEFCFVA4XAQ, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.155809128 (72h32m6.195382248s) [noise=true , address=45.91.116.4:4937 , piece_id=DOEL7QH4KH65JRMT3FZ6UJEY7MC67HHTTV6II7F6RPF35M4QO7RQ, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.156044798 (72h32m6.195617918s) [noise=true , address=45.91.116.14:4190 , piece_id=M6HX5AISWMOYIQQVUU7IDPSGSI5QRW5YXZ4IYOJ2ZAHXGU5H25KA, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.156289406 (72h32m6.195862526s) [noise=true , address=77.90.31.14:4663 , piece_id=R4W4RNOK7QWU7SBZIRIPPCP5H5IMKUVTYWTLCKJ72A3FAU2GZC3Q, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.156529997 (72h32m6.196103117s) [noise=true , address=45.91.116.11:4117 , piece_id=Y5NSEN7XYOZI5LPTFD6JSQCPHTZZDTBCECXYFRAFZGUZ2Y24PSPQ, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.156763785 (72h32m6.196336905s) [noise=true , address=77.90.31.16:4733 , piece_id=PK372BCQELEO5H4HDG4HJYNIL76UZEOVTVTI6J45KVUKMHPWRIJA, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.156983144 (72h32m6.196556264s) [noise=true , address=77.90.31.13:4626 , piece_id=NDQMHM537MP4ZWPABGNVF6XVDOP7IRQSKVQ53X55MD6XXAFBTFRA, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.157192053 (72h32m6.196765173s) [noise=true , address=145.79.227.16:4909 , piece_id=MBXLQSNDYXBNUEZDJQ6E6E7U3OJMFEAXJEBHOQKA6ZEHH54HWYBA, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.157405101 (72h32m6.196978231s) [noise=true , address=45.91.116.13:4153 , piece_id=6DZPVINDIIYVRO5SZIGEFXZTXRQPBFSEGVVVXGZ4Q5PX6Q6YDQ3A, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.157611006 (72h32m6.197184126s) [noise=true , address=77.90.31.10:4519 , piece_id=SIKYTXXZAE6ZQWZ7JJ6L5CPOIRCZYOAOQW5MIDZYCGPPL2UMO5NA, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.158022072 (72h32m6.197595192s) [noise=true , address=77.90.31.19:4842 , piece_id=ARKIJUZPNFONYILNE26IZQXWI3JBOHDIIADMQGTAN3LT5N6A3IXA, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.158296397 (72h32m6.197869517s) [noise=true , address=77.90.31.21:4879 , piece_id=UMEDJREG7FVWFWLSZIKWJWKGWKG42ADCWD4PU7WQ2HKY5RDYE56A, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.158963513 (72h32m6.198536643s) [noise=true , address=77.90.31.18:4805 , piece_id=ZKPVGTAHHHVIKMOPBHHTH3BHCVHMX2U5LX7SWKNKPKPNZNLZ7VVA, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:30.159372446 (72h32m6.198945566s) [noise=true , address=45.91.116.6:4975 , piece_id=7UNSCISEIA2LT23FDTF2BTUUPZC4WFTTPAJPXWMWTC536CRIWRBA, seg_pos={0 0}, upload=63839]: Uploading piece... Sep 9 14:00:32.040257830 (72h32m8.079830961s) [upload=63839]: Next returned nil segment Sep 9 14:00:32.040286756 (72h32m8.079859876s) [upload=63839]: Waiting for error group managing segments... Sep 9 14:00:32.389316817 (72h32m8.428889947s) [noise=true , address=77.90.31.10:4517 , piece_id=4LCXEBL47HW34JHV6XNMSTOLZJYDV4VJT5363JHLBKOTDG3HG24A, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.398314274 (72h32m8.437887404s) [noise=true , address=45.91.116.11:4117 , piece_id=Y5NSEN7XYOZI5LPTFD6JSQCPHTZZDTBCECXYFRAFZGUZ2Y24PSPQ, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.436280696 (72h32m8.475853816s) [noise=true , address=45.91.116.6:4975 , piece_id=7UNSCISEIA2LT23FDTF2BTUUPZC4WFTTPAJPXWMWTC536CRIWRBA, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.439966569 (72h32m8.479539689s) [noise=true , address=77.90.31.16:4734 , piece_id=LRGGT2PFAW6ZTFEU7NF4N52ANHFD5PHV4DZJKWXLS26JE6GC7APQ, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.471882082 (72h32m8.511455212s) [noise=true , address=45.91.116.14:4190 , piece_id=M6HX5AISWMOYIQQVUU7IDPSGSI5QRW5YXZ4IYOJ2ZAHXGU5H25KA, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.478577615 (72h32m8.518150745s) [noise=true , address=77.90.31.14:4663 , piece_id=R4W4RNOK7QWU7SBZIRIPPCP5H5IMKUVTYWTLCKJ72A3FAU2GZC3Q, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.488928502 (72h32m8.528501622s) [noise=true , address=77.90.31.19:4842 , piece_id=ARKIJUZPNFONYILNE26IZQXWI3JBOHDIIADMQGTAN3LT5N6A3IXA, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.490800775 (72h32m8.530373895s) [noise=true , address=145.79.227.16:4909 , piece_id=MBXLQSNDYXBNUEZDJQ6E6E7U3OJMFEAXJEBHOQKA6ZEHH54HWYBA, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.491486688 (72h32m8.531059808s) [noise=true , address=77.90.31.10:4519 , piece_id=SIKYTXXZAE6ZQWZ7JJ6L5CPOIRCZYOAOQW5MIDZYCGPPL2UMO5NA, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.491707130 (72h32m8.53128025s) [noise=true , address=45.91.116.13:4153 , piece_id=6DZPVINDIIYVRO5SZIGEFXZTXRQPBFSEGVVVXGZ4Q5PX6Q6YDQ3A, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.505725886 (72h32m8.545299006s) [noise=true , address=77.90.31.16:4733 , piece_id=PK372BCQELEO5H4HDG4HJYNIL76UZEOVTVTI6J45KVUKMHPWRIJA, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.514017923 (72h32m8.553591043s) [noise=true , address=77.90.31.18:4805 , piece_id=ZKPVGTAHHHVIKMOPBHHTH3BHCVHMX2U5LX7SWKNKPKPNZNLZ7VVA, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.589082136 (72h32m8.628655256s) [noise=true , address=45.91.116.4:4937 , piece_id=DOEL7QH4KH65JRMT3FZ6UJEY7MC67HHTTV6II7F6RPF35M4QO7RQ, seg_pos={0 0}, upload=63839]: Done uploading piece. err: <nil> Sep 9 14:00:32.589114938 (72h32m8.628688058s) [seg_pos={0 0}, upload=63839]: Segment reached optimal threshold of 13 pieces. Sep 9 14:00:32.590572919 (72h32m8.630146049s) [noise=true , address=45.91.116.13:4155 , piece_id=JBBEZDHLCOE4Z7L2OGLO4ILKC6QRJXWWNOIGLULBZZEFCFVA4XAQ, seg_pos={0 0}, upload=63839]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF Sep 9 14:00:32.590679041 (72h32m8.630252161s) [noise=true , address=77.90.31.13:4626 , piece_id=NDQMHM537MP4ZWPABGNVF6XVDOP7IRQSKVQ53X55MD6XXAFBTFRA, seg_pos={0 0}, upload=63839]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: write tcp 188.166.225.170:53346->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:53346->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53346->77.90.31.13:4626: use of closed network connection Sep 9 14:00:32.590718307 (72h32m8.630291427s) [noise=true , address=77.90.31.21:4879 , piece_id=UMEDJREG7FVWFWLSZIKWJWKGWKG42ADCWD4PU7WQ2HKY5RDYE56A, seg_pos={0 0}, upload=63839]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF Sep 9 14:00:32.590772150 (72h32m8.63034528s) [seg_pos={0 0}, upload=63839]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:00:32.590843597 (72h32m8.630416717s) [upload=63839]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:00:32.590847785 (72h32m8.630420905s) [upload=63839]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:00:32.915222986 (72h32m8.954796137s) [upload=63839]: Done uploading segments... Sep 9 14:00:32.915250770 (72h32m8.95482389s) [upload=63839]: Upload finished. err: <nil> Duration: 30.002300971s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [X................X..........X............................XXX] duration: 30.002562806s FAIL (2025-09-09 14:00:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:59:59.426381265 (72h31m35.465954385s) [upload=63835]: Starting upload Sep 9 13:59:59.426435649 (72h31m35.466008769s) [upload=63835]: Done starting upload Sep 9 13:59:59.426497488 (72h31m35.466070608s) [upload=63835]: Uploading segments... Sep 9 13:59:59.426633188 (72h31m35.466206308s) [upload=63835]: Got next segment. Inline: false Sep 9 13:59:59.426657334 (72h31m35.466230454s) [upload=63835]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:59:59.426661632 (72h31m35.466234752s) [upload=63835]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:59:59.700568487 (72h31m35.740141607s) [seg_pos={0 0}, upload=63835]: Begin upload segment... Sep 9 13:59:59.700624566 (72h31m35.740197686s) [seg_pos={0 0}, upload=63835]: Done begin upload segment. Sep 9 13:59:59.700649312 (72h31m35.740222422s) [noise=true , address=45.91.116.9:4263 , piece_id=6JUH3CGLNJKY7DLPQOJZLETZXGK3FFX4AZCRN34HJT25FMGTPXEQ, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.701055830 (72h31m35.74062895s) [noise=true , address=45.91.116.11:4118 , piece_id=ZZBKCHVENV5FXARHHQXJKC4WDKI3BZLLY7APFP52GIUFBRRO47SQ, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.701491043 (72h31m35.741064153s) [noise=true , address=145.79.227.15:4874 , piece_id=5CDP4CCFY4KA4M57NQUFOLLX3A77DB5CZVGZDBRVFUK22EBIKRFA, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.701781449 (72h31m35.741354579s) [noise=true , address=145.79.227.3:4151 , piece_id=SJAKH4FSMUY6W5LDSXONPIXH55ITNTXLZ5T2P7GIZFEU6KCPZRZA, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.701889476 (72h31m35.741462586s) [noise=true , address=77.90.31.21:4879 , piece_id=HUIFBIQ2E6WG4VLIL6UDOH3MUE3ITO3ZDQWVQNMYI2GOXEUZZRQQ, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.702333395 (72h31m35.741906515s) [noise=true , address=45.91.116.14:4191 , piece_id=LDYCV5VLGHDI4IC6B5BWWLTCW5A7NTP2Y5AYXMRKAEYBUK52OTPA, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.702828843 (72h31m35.742401963s) [noise=true , address=77.90.31.10:4519 , piece_id=FW62LCPACVGCN7ITCI4GB32B6OP354U2TBUKSRPDSDOZYA2DYJ6Q, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.703339200 (72h31m35.74291232s) [noise=true , address=45.91.116.13:4153 , piece_id=WPNQN2IU3FI5B5Y3WKCELTYOLCAK62H655KCSCSRHD2XY4X2BKUA, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.703874474 (72h31m35.743447595s) [noise=true , address=77.90.31.13:4626 , piece_id=FC6E23KJI3V3Z5LQEBH3GC4FEUQUSB3ODIHBFRJUSWD7ZEKUGTKQ, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.704128801 (72h31m35.743701921s) [noise=true , address=45.91.116.6:4975 , piece_id=TWNZU74LVWF26P25PXCJXEEBI6I4UAXF42CLBVBKCRLF6H3QNGWA, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.704400421 (72h31m35.743973531s) [noise=true , address=145.79.227.19:4079 , piece_id=ASPPZCO3DTR3QDQDM7D32BITQ5YFKGEJF2OCCZWVH56HIBDPAU7Q, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.704684995 (72h31m35.744258115s) [noise=true , address=45.91.116.10:4082 , piece_id=V66GIJBR4DWUKLGNJ3W7KJASPIAZYJMTUVAQZU4V33PY7A3QHWGA, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.705036147 (72h31m35.744609267s) [noise=true , address=77.90.31.12:4589 , piece_id=AWEPE5UQR4DRTVDKMYBURLZZKJ3ZMYLAXE3DFBYVTWEV2LCIJKTQ, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.705467332 (72h31m35.745040452s) [noise=true , address=45.91.116.12:4226 , piece_id=FXZVMBIM3JDOWCJCBOMZ25XG4CNWITTMT3DCMYKUXLEXUDSBRBKQ, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.706645737 (72h31m35.746218857s) [noise=true , address=45.91.116.8:4048 , piece_id=QELDHNS7WNAJCKWV7LA7QWZ3JOQGV5ZAYG3I3KD5D4E6CAERUQKA, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 13:59:59.707512716 (72h31m35.747085836s) [noise=true , address=45.91.116.5:4297 , piece_id=3S377S6GXYDTCT2U4RPVV2NVDG5WC2LA5CZPXX3HZWIXSJHIBWFQ, seg_pos={0 0}, upload=63835]: Uploading piece... Sep 9 14:00:01.484879117 (72h31m37.524452247s) [upload=63835]: Next returned nil segment Sep 9 14:00:01.484901720 (72h31m37.52447485s) [upload=63835]: Waiting for error group managing segments... Sep 9 14:00:01.775070976 (72h31m37.814644106s) [noise=true , address=145.79.227.19:4079 , piece_id=ASPPZCO3DTR3QDQDM7D32BITQ5YFKGEJF2OCCZWVH56HIBDPAU7Q, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:01.846135634 (72h31m37.885708764s) [noise=true , address=145.79.227.15:4874 , piece_id=5CDP4CCFY4KA4M57NQUFOLLX3A77DB5CZVGZDBRVFUK22EBIKRFA, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:01.925290715 (72h31m37.964863855s) [noise=true , address=45.91.116.14:4191 , piece_id=LDYCV5VLGHDI4IC6B5BWWLTCW5A7NTP2Y5AYXMRKAEYBUK52OTPA, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:01.977759378 (72h31m38.017332508s) [noise=true , address=45.91.116.13:4153 , piece_id=WPNQN2IU3FI5B5Y3WKCELTYOLCAK62H655KCSCSRHD2XY4X2BKUA, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:01.992833033 (72h31m38.032406163s) [noise=true , address=45.91.116.5:4297 , piece_id=3S377S6GXYDTCT2U4RPVV2NVDG5WC2LA5CZPXX3HZWIXSJHIBWFQ, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:01.993542100 (72h31m38.03311523s) [noise=true , address=45.91.116.9:4263 , piece_id=6JUH3CGLNJKY7DLPQOJZLETZXGK3FFX4AZCRN34HJT25FMGTPXEQ, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:02.027048607 (72h31m38.066621738s) [noise=true , address=77.90.31.12:4589 , piece_id=AWEPE5UQR4DRTVDKMYBURLZZKJ3ZMYLAXE3DFBYVTWEV2LCIJKTQ, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:02.027787752 (72h31m38.067360882s) [noise=true , address=77.90.31.10:4519 , piece_id=FW62LCPACVGCN7ITCI4GB32B6OP354U2TBUKSRPDSDOZYA2DYJ6Q, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:02.059858001 (72h31m38.099431142s) [noise=true , address=45.91.116.8:4048 , piece_id=QELDHNS7WNAJCKWV7LA7QWZ3JOQGV5ZAYG3I3KD5D4E6CAERUQKA, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:02.307867038 (72h31m38.347440168s) [noise=true , address=77.90.31.13:4626 , piece_id=FC6E23KJI3V3Z5LQEBH3GC4FEUQUSB3ODIHBFRJUSWD7ZEKUGTKQ, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:02.447699631 (72h31m38.487272761s) [noise=true , address=145.79.227.3:4151 , piece_id=SJAKH4FSMUY6W5LDSXONPIXH55ITNTXLZ5T2P7GIZFEU6KCPZRZA, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:02.684364452 (72h31m38.723937582s) [noise=true , address=45.91.116.11:4118 , piece_id=ZZBKCHVENV5FXARHHQXJKC4WDKI3BZLLY7APFP52GIUFBRRO47SQ, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:02.729245015 (72h31m38.768818145s) [noise=true , address=45.91.116.6:4975 , piece_id=TWNZU74LVWF26P25PXCJXEEBI6I4UAXF42CLBVBKCRLF6H3QNGWA, seg_pos={0 0}, upload=63835]: Done uploading piece. err: <nil> Sep 9 14:00:02.729287707 (72h31m38.768860847s) [seg_pos={0 0}, upload=63835]: Segment reached optimal threshold of 13 pieces. Sep 9 14:00:02.729527616 (72h31m38.769100746s) [noise=true , address=77.90.31.21:4879 , piece_id=HUIFBIQ2E6WG4VLIL6UDOH3MUE3ITO3ZDQWVQNMYI2GOXEUZZRQQ, seg_pos={0 0}, upload=63835]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF Sep 9 14:00:02.729590576 (72h31m38.769163706s) [noise=true , address=45.91.116.10:4082 , piece_id=V66GIJBR4DWUKLGNJ3W7KJASPIAZYJMTUVAQZU4V33PY7A3QHWGA, seg_pos={0 0}, upload=63835]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:56020->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:56020->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56020->45.91.116.10:4082: use of closed network connection Sep 9 14:00:02.730198028 (72h31m38.769771168s) [noise=true , address=45.91.116.12:4226 , piece_id=FXZVMBIM3JDOWCJCBOMZ25XG4CNWITTMT3DCMYKUXLEXUDSBRBKQ, seg_pos={0 0}, upload=63835]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: read tcp 188.166.225.170:42352->45.91.116.12:4226: use of closed network connection; conn closed: op Sep 9 14:00:02.730232445 (72h31m38.769805575s) [seg_pos={0 0}, upload=63835]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 14:00:02.730334620 (72h31m38.76990775s) [upload=63835]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 14:00:02.730341173 (72h31m38.769914303s) [upload=63835]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 14:00:03.078104808 (72h31m39.117677938s) [upload=63835]: Done uploading segments... Sep 9 14:00:03.078131199 (72h31m39.117704329s) [upload=63835]: Upload finished. err: <nil> Duration: 30.002591471s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [XX................X..........X............................XX] duration: 30.002903635s FAIL (2025-09-09 13:59:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:59:19.565725171 (72h30m55.605298301s) [upload=63822]: Starting upload Sep 9 13:59:19.565854759 (72h30m55.605427879s) [upload=63822]: Done starting upload Sep 9 13:59:19.566123342 (72h30m55.605696462s) [upload=63822]: Uploading segments... Sep 9 13:59:19.566206121 (72h30m55.605779241s) [upload=63822]: Got next segment. Inline: false Sep 9 13:59:19.566236169 (72h30m55.605809289s) [upload=63822]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:59:19.566240437 (72h30m55.605813557s) [upload=63822]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:59:19.832464742 (72h30m55.872037862s) [seg_pos={0 0}, upload=63822]: Begin upload segment... Sep 9 13:59:19.832509538 (72h30m55.872082658s) [seg_pos={0 0}, upload=63822]: Done begin upload segment. Sep 9 13:59:19.832543973 (72h30m55.872117093s) [noise=true , address=45.91.116.11:4119 , piece_id=4GRRBCVBRJBRKLZVES77VBFC5GKORJXSZAVZJRTVHCANO5J7YOXA, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.832576405 (72h30m55.872149525s) [noise=true , address=45.91.116.7:4010 , piece_id=BRTIP3KOG6NQHWYTLFQVQ5FYR4FRKM5ZJYRERBGG3C56UDZMKYQA, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.833000738 (72h30m55.872573848s) [noise=true , address=145.79.227.5:4222 , piece_id=TY65WNQYSBGXTV6TYT4EWCCARPLSZHWG6OAMKQY5HJGAYW5VRODA, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.833150584 (72h30m55.872723704s) [noise=true , address=77.90.31.14:4661 , piece_id=2D7W5I7YS6RV6GBYEHY3GFPZNE6NIF4X5S7VATOLIB2CIQ63QWVQ, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.833284180 (72h30m55.8728573s) [noise=true , address=45.91.116.6:4975 , piece_id=L3BEYBEQ4DXBWMPRGREYWQXZOS4B2PHLRW4PNFCMWKXXA4NKBF6Q, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.833551211 (72h30m55.873124331s) [noise=true , address=45.91.116.13:4154 , piece_id=SBTFXU2HM43LEOZD32DHYCVYTMXLWWI6PK5DP5MWGPSQXI72V2DA, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.833631645 (72h30m55.873204765s) [noise=true , address=77.90.31.21:4877 , piece_id=PXBTMUXT2PYTQFO2GH2UBDHPV3QT4YNJPUTGAZFLCNAKTO2QGHUA, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.833841968 (72h30m55.873415088s) [noise=true , address=45.91.116.10:4081 , piece_id=XXF7UHTDP3GA7UGR5LQYMKKLJT5WJIY2V3B4G3F5OJSOZM63ZLNA, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.834164774 (72h30m55.873737894s) [noise=true , address=77.90.31.17:4771 , piece_id=GEG73FRETHR24W4PZPSMDEZZLUG63P44MPYHQLXNEV265JNIM3QQ, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.834410134 (72h30m55.873983254s) [noise=true , address=77.90.31.16:4733 , piece_id=6QUHRR4VJTQUOHKISWXNAWG2BLZMOU7L4NRUQF5OFFG56D5IW7DA, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.834665103 (72h30m55.874238223s) [noise=true , address=45.91.116.12:4225 , piece_id=OC7FUNA6KQWSMOSLCO3SMQARE46D3P666FO3RZQURKCYC6AJUQXQ, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.834873741 (72h30m55.874446861s) [noise=true , address=77.90.31.12:4589 , piece_id=5265DFC6I3LMB6PV3KMWUCKYMYRLTDJ4IVHQLRUQB75ZD6DGM3VA, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.834957581 (72h30m55.874530702s) [noise=true , address=45.91.116.9:4263 , piece_id=S6U5JEZP5PSOHS7TBAVRAAZFG4X5WYZAB26AYN3LQ7LG72WVADNQ, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.835214614 (72h30m55.874787734s) [noise=true , address=145.79.227.7:4293 , piece_id=CLD27Y5QXV43QI2ZJA7HFZA5Z4YVLUN2Y6WKMYMYII56CTPJCTEQ, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.835453180 (72h30m55.8750263s) [noise=true , address=77.90.31.18:4805 , piece_id=UGVFHVNRMARY4NB7U3ELJ27WBIH5XGOYKFU3ZT2DYMZZPC436PAA, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:19.835761290 (72h30m55.87533441s) [noise=true , address=77.90.31.15:4698 , piece_id=5BUY4FXWE5KJ4APFDQD3GF7RGAAH3AHWLKGJYEYZ42QIY4GFFV5A, seg_pos={0 0}, upload=63822]: Uploading piece... Sep 9 13:59:21.751721053 (72h30m57.791294173s) [upload=63822]: Next returned nil segment Sep 9 13:59:21.751738647 (72h30m57.791311757s) [upload=63822]: Waiting for error group managing segments... Sep 9 13:59:22.060163997 (72h30m58.099737107s) [noise=true , address=45.91.116.6:4975 , piece_id=L3BEYBEQ4DXBWMPRGREYWQXZOS4B2PHLRW4PNFCMWKXXA4NKBF6Q, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.065013567 (72h30m58.104586747s) [noise=true , address=45.91.116.12:4225 , piece_id=OC7FUNA6KQWSMOSLCO3SMQARE46D3P666FO3RZQURKCYC6AJUQXQ, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.093274357 (72h30m58.132847477s) [noise=true , address=77.90.31.14:4661 , piece_id=2D7W5I7YS6RV6GBYEHY3GFPZNE6NIF4X5S7VATOLIB2CIQ63QWVQ, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.126011873 (72h30m58.165584993s) [noise=true , address=45.91.116.13:4154 , piece_id=SBTFXU2HM43LEOZD32DHYCVYTMXLWWI6PK5DP5MWGPSQXI72V2DA, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.131427957 (72h30m58.171001067s) [noise=true , address=45.91.116.7:4010 , piece_id=BRTIP3KOG6NQHWYTLFQVQ5FYR4FRKM5ZJYRERBGG3C56UDZMKYQA, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.142631746 (72h30m58.182204866s) [noise=true , address=77.90.31.16:4733 , piece_id=6QUHRR4VJTQUOHKISWXNAWG2BLZMOU7L4NRUQF5OFFG56D5IW7DA, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.147415160 (72h30m58.18698828s) [noise=true , address=45.91.116.11:4119 , piece_id=4GRRBCVBRJBRKLZVES77VBFC5GKORJXSZAVZJRTVHCANO5J7YOXA, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.154717894 (72h30m58.194291014s) [noise=true , address=77.90.31.12:4589 , piece_id=5265DFC6I3LMB6PV3KMWUCKYMYRLTDJ4IVHQLRUQB75ZD6DGM3VA, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.189751174 (72h30m58.229324294s) [noise=true , address=77.90.31.15:4698 , piece_id=5BUY4FXWE5KJ4APFDQD3GF7RGAAH3AHWLKGJYEYZ42QIY4GFFV5A, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.396454179 (72h30m58.436027299s) [noise=true , address=77.90.31.17:4771 , piece_id=GEG73FRETHR24W4PZPSMDEZZLUG63P44MPYHQLXNEV265JNIM3QQ, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.720384309 (72h30m58.759957429s) [noise=true , address=77.90.31.21:4877 , piece_id=PXBTMUXT2PYTQFO2GH2UBDHPV3QT4YNJPUTGAZFLCNAKTO2QGHUA, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.852268020 (72h30m58.89184114s) [noise=true , address=45.91.116.9:4263 , piece_id=S6U5JEZP5PSOHS7TBAVRAAZFG4X5WYZAB26AYN3LQ7LG72WVADNQ, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.897653910 (72h30m58.937227031s) [noise=true , address=145.79.227.7:4293 , piece_id=CLD27Y5QXV43QI2ZJA7HFZA5Z4YVLUN2Y6WKMYMYII56CTPJCTEQ, seg_pos={0 0}, upload=63822]: Done uploading piece. err: <nil> Sep 9 13:59:22.897704097 (72h30m58.937277217s) [seg_pos={0 0}, upload=63822]: Segment reached optimal threshold of 13 pieces. Sep 9 13:59:22.897890463 (72h30m58.937463584s) [noise=true , address=45.91.116.10:4081 , piece_id=XXF7UHTDP3GA7UGR5LQYMKKLJT5WJIY2V3B4G3F5OJSOZM63ZLNA, seg_pos={0 0}, upload=63822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Sep 9 13:59:22.898000574 (72h30m58.937573694s) [noise=true , address=77.90.31.18:4805 , piece_id=UGVFHVNRMARY4NB7U3ELJ27WBIH5XGOYKFU3ZT2DYMZZPC436PAA, seg_pos={0 0}, upload=63822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Sep 9 13:59:22.898016785 (72h30m58.937589905s) [noise=true , address=145.79.227.5:4222 , piece_id=TY65WNQYSBGXTV6TYT4EWCCARPLSZHWG6OAMKQY5HJGAYW5VRODA, seg_pos={0 0}, upload=63822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: write tcp 188.166.225.170:37038->145.79.227.5:4222: use of closed network connection; write tcp 188.166.225.170:37038->145.79.227.5:4222: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37038->145.79.227.5:4222: use of closed network connection Sep 9 13:59:22.898030321 (72h30m58.937603441s) [seg_pos={0 0}, upload=63822]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:59:22.898124220 (72h30m58.93769734s) [upload=63822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:59:22.898128198 (72h30m58.937701318s) [upload=63822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:59:23.244409950 (72h30m59.28398307s) [upload=63822]: Done uploading segments... Sep 9 13:59:23.244428065 (72h30m59.284001185s) [upload=63822]: Upload finished. err: <nil> Duration: 30.0029269s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.XX................X..........X............................X] duration: 30.001535581s FAIL (2025-09-09 13:58:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:58:05.804635127 (72h29m41.844208247s) [upload=63803]: Starting upload Sep 9 13:58:05.804695593 (72h29m41.844268713s) [upload=63803]: Done starting upload Sep 9 13:58:05.804806595 (72h29m41.844379725s) [upload=63803]: Uploading segments... Sep 9 13:58:05.804864796 (72h29m41.844437916s) [upload=63803]: Got next segment. Inline: false Sep 9 13:58:05.804894192 (72h29m41.844467313s) [upload=63803]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:58:05.804898561 (72h29m41.844471681s) [upload=63803]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:58:06.072032397 (72h29m42.111605517s) [seg_pos={0 0}, upload=63803]: Begin upload segment... Sep 9 13:58:06.072074818 (72h29m42.111647938s) [seg_pos={0 0}, upload=63803]: Done begin upload segment. Sep 9 13:58:06.072103413 (72h29m42.111676533s) [noise=true , address=45.91.116.14:4190 , piece_id=6JWHOGVYFQARRT3FMW4S6OAS75RAFNXLYN4X2RIQEXAOGO7W7UOA, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.072134353 (72h29m42.111707473s) [noise=true , address=45.91.116.9:4262 , piece_id=LMDIYVXK7FFSRZODGBG3AJFMOQP37CC52RX5FHIXPKABYHEYTUDQ, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.072460155 (72h29m42.112033275s) [noise=true , address=45.91.116.12:4226 , piece_id=5HWFP3IUHT5Z4RUJ4XZYS7XZLVBVBM7K5JHUHGNM3RRIPUNLSQNQ, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.072540209 (72h29m42.112113329s) [noise=true , address=77.90.31.16:4733 , piece_id=VDKHX5ZYSKOHFU4SCQWYLXJNHLNQUNJD75OYDV6CRE3D74BC455Q, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.072737797 (72h29m42.112310917s) [noise=true , address=77.90.31.14:4661 , piece_id=FB7UZKMMTX7ON7PO5JC6S7EJFWRO5L7YGP5UZNXDYP7UDT2SCL7Q, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.072801890 (72h29m42.11237501s) [noise=true , address=45.91.116.5:4297 , piece_id=SBCVGHB2FACLTVN3ERKEIWOBFKRLFR2326QA53ND6IHM3P6CYYLA, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.072999688 (72h29m42.112572808s) [noise=true , address=77.90.31.19:4843 , piece_id=IXOA4RNV7KSEVLJJTU5NF5U4O6S2VFICAF5R6CH54C344CMWKOHQ, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.073124808 (72h29m42.112697928s) [noise=true , address=45.91.116.12:4227 , piece_id=HTOYT6BNRJVJDALWPP5O6T6CCQIOVK6LB4HRJFUD665CPHH6POTQ, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.073259466 (72h29m42.112832586s) [noise=true , address=77.90.31.12:4589 , piece_id=66MGYAGKOJ2R7S2KZJSQKJ76GHV6H3QCPKJGY4U3RPW3AQOPKQ2A, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.073370137 (72h29m42.112943257s) [noise=true , address=77.90.31.10:4517 , piece_id=DO67HEFNBZP7HIOZVAQJNGNEGVVEIRHK7G32EPGTAMVDXXWJPWLQ, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.073481089 (72h29m42.11305421s) [noise=true , address=77.90.31.14:4662 , piece_id=ZIVPZ746WYEV2XXTGNN64WE4W2BOWXBHWYHPGTKGRWW7TKUV4KKA, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.073694408 (72h29m42.113267528s) [noise=true , address=45.91.116.10:4083 , piece_id=45VIJFXOCZFUY5J76W3AIIH7JU73LAW4IR2VC6BXU4RZ5CQXCMKQ, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.074030180 (72h29m42.1136033s) [noise=true , address=145.79.227.3:4150 , piece_id=6QLM72L7PUWFVM4R6ZA5VZMZGBJ4LYNYZIS6MQX7CWGTXMW3MGTA, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.074249099 (72h29m42.113822219s) [noise=true , address=45.91.116.4:4939 , piece_id=6CDQAXZW3CAVDEBKFJVB6OU2HI77Q7SXB3K5FXKACXX55XDUW54Q, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.074454643 (72h29m42.114027763s) [noise=true , address=77.90.31.19:4842 , piece_id=PW7WLITGLGIYURUXJXPKDV667AB2BOOYUCVZMXWDAS6Z6PC4CUEA, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:06.074698750 (72h29m42.11427187s) [noise=true , address=77.90.31.13:4627 , piece_id=HBXKQ4QGP2MTUQU4KHP37AMAK2OED4ZK5RTZ4E2FFFBF7V5DX5ZA, seg_pos={0 0}, upload=63803]: Uploading piece... Sep 9 13:58:07.853235897 (72h29m43.892809017s) [upload=63803]: Next returned nil segment Sep 9 13:58:07.853253751 (72h29m43.892826871s) [upload=63803]: Waiting for error group managing segments... Sep 9 13:58:08.132438497 (72h29m44.172011617s) [noise=true , address=145.79.227.3:4150 , piece_id=6QLM72L7PUWFVM4R6ZA5VZMZGBJ4LYNYZIS6MQX7CWGTXMW3MGTA, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.252818545 (72h29m44.292391665s) [noise=true , address=45.91.116.5:4297 , piece_id=SBCVGHB2FACLTVN3ERKEIWOBFKRLFR2326QA53ND6IHM3P6CYYLA, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.261193361 (72h29m44.300766481s) [noise=true , address=45.91.116.10:4083 , piece_id=45VIJFXOCZFUY5J76W3AIIH7JU73LAW4IR2VC6BXU4RZ5CQXCMKQ, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.262791719 (72h29m44.302364839s) [noise=true , address=45.91.116.12:4227 , piece_id=HTOYT6BNRJVJDALWPP5O6T6CCQIOVK6LB4HRJFUD665CPHH6POTQ, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.277258934 (72h29m44.316832054s) [noise=true , address=45.91.116.12:4226 , piece_id=5HWFP3IUHT5Z4RUJ4XZYS7XZLVBVBM7K5JHUHGNM3RRIPUNLSQNQ, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.291266569 (72h29m44.330839689s) [noise=true , address=77.90.31.19:4843 , piece_id=IXOA4RNV7KSEVLJJTU5NF5U4O6S2VFICAF5R6CH54C344CMWKOHQ, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.323891771 (72h29m44.363464901s) [noise=true , address=77.90.31.12:4589 , piece_id=66MGYAGKOJ2R7S2KZJSQKJ76GHV6H3QCPKJGY4U3RPW3AQOPKQ2A, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.335597711 (72h29m44.375170831s) [noise=true , address=77.90.31.14:4662 , piece_id=ZIVPZ746WYEV2XXTGNN64WE4W2BOWXBHWYHPGTKGRWW7TKUV4KKA, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.362826315 (72h29m44.402399435s) [noise=true , address=77.90.31.14:4661 , piece_id=FB7UZKMMTX7ON7PO5JC6S7EJFWRO5L7YGP5UZNXDYP7UDT2SCL7Q, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.363217473 (72h29m44.402790593s) [noise=true , address=77.90.31.16:4733 , piece_id=VDKHX5ZYSKOHFU4SCQWYLXJNHLNQUNJD75OYDV6CRE3D74BC455Q, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.364628574 (72h29m44.404201694s) [noise=true , address=45.91.116.9:4262 , piece_id=LMDIYVXK7FFSRZODGBG3AJFMOQP37CC52RX5FHIXPKABYHEYTUDQ, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.372662408 (72h29m44.412235528s) [noise=true , address=77.90.31.10:4517 , piece_id=DO67HEFNBZP7HIOZVAQJNGNEGVVEIRHK7G32EPGTAMVDXXWJPWLQ, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.427195081 (72h29m44.466768201s) [noise=true , address=77.90.31.13:4627 , piece_id=HBXKQ4QGP2MTUQU4KHP37AMAK2OED4ZK5RTZ4E2FFFBF7V5DX5ZA, seg_pos={0 0}, upload=63803]: Done uploading piece. err: <nil> Sep 9 13:58:08.427222433 (72h29m44.466795553s) [seg_pos={0 0}, upload=63803]: Segment reached optimal threshold of 13 pieces. Sep 9 13:58:08.427415833 (72h29m44.466988953s) [noise=true , address=45.91.116.4:4939 , piece_id=6CDQAXZW3CAVDEBKFJVB6OU2HI77Q7SXB3K5FXKACXX55XDUW54Q, seg_pos={0 0}, upload=63803]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 9 13:58:08.427493342 (72h29m44.467066462s) [noise=true , address=77.90.31.19:4842 , piece_id=PW7WLITGLGIYURUXJXPKDV667AB2BOOYUCVZMXWDAS6Z6PC4CUEA, seg_pos={0 0}, upload=63803]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: write tcp 188.166.225.170:50292->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:50292->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50292->77.90.31.19:4842: use of closed network connection Sep 9 13:58:08.427531464 (72h29m44.467104584s) [noise=true , address=45.91.116.14:4190 , piece_id=6JWHOGVYFQARRT3FMW4S6OAS75RAFNXLYN4X2RIQEXAOGO7W7UOA, seg_pos={0 0}, upload=63803]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:43450->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:43450->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43450->45.91.116.14:4190: use of closed network connection Sep 9 13:58:08.427550701 (72h29m44.467123821s) [seg_pos={0 0}, upload=63803]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:58:08.427606819 (72h29m44.467179939s) [upload=63803]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:58:08.427610325 (72h29m44.467183445s) [upload=63803]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:58:08.754161451 (72h29m44.793734571s) [upload=63803]: Done uploading segments... Sep 9 13:58:08.754180737 (72h29m44.793753857s) [upload=63803]: Upload finished. err: <nil> Duration: 30.001561431s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..XX................X..........X............................] duration: 14.294253814s FAIL (2025-09-09 13:57:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:36:24.699178170 (72h8m0.73875128s) [upload=63482]: Starting upload Sep 9 13:36:24.699248395 (72h8m0.738821515s) [upload=63482]: Done starting upload Sep 9 13:36:24.699369106 (72h8m0.738942226s) [upload=63482]: Uploading segments... Sep 9 13:36:24.699446644 (72h8m0.739019764s) [upload=63482]: Got next segment. Inline: false Sep 9 13:36:24.699475770 (72h8m0.73904889s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:36:24.699480779 (72h8m0.739053899s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:36:24.952807291 (72h8m0.992380411s) [seg_pos={0 0}, upload=63482]: Begin upload segment... Sep 9 13:36:24.952868047 (72h8m0.992441167s) [seg_pos={0 0}, upload=63482]: Done begin upload segment. Sep 9 13:36:24.952898024 (72h8m0.992471144s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.952910428 (72h8m0.992483548s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953331383 (72h8m0.992904503s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953461392 (72h8m0.993034512s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953618634 (72h8m0.993191754s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953996036 (72h8m0.993569156s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954288655 (72h8m0.993861775s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954717907 (72h8m0.994291027s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954832666 (72h8m0.994405796s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955238142 (72h8m0.994811272s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955632758 (72h8m0.995205878s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955882025 (72h8m0.995455145s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956205935 (72h8m0.995779055s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956470330 (72h8m0.99604345s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956744094 (72h8m0.996317214s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.957199616 (72h8m0.996772736s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:26.711484588 (72h8m2.751057718s) [upload=63482]: Next returned nil segment Sep 9 13:36:26.711510889 (72h8m2.751084019s) [upload=63482]: Waiting for error group managing segments... Sep 9 13:36:27.118203368 (72h8m3.157776488s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.126206664 (72h8m3.165779794s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.171414553 (72h8m3.210987693s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.179550181 (72h8m3.219123301s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.191175036 (72h8m3.230748156s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206756021 (72h8m3.246329172s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206944202 (72h8m3.246517322s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.213110421 (72h8m3.252683541s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.258260740 (72h8m3.29783386s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.290952699 (72h8m3.330525829s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.322648582 (72h8m3.362221702s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.611398359 (72h8m3.650971479s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910860115 (72h8m3.950433235s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910886365 (72h8m3.950459485s) [seg_pos={0 0}, upload=63482]: Segment reached optimal threshold of 13 pieces. Sep 9 13:36:27.911001385 (72h8m3.950574505s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911164327 (72h8m3.950737447s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911216317 (72h8m3.950789437s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911253397 (72h8m3.950826517s) [seg_pos={0 0}, upload=63482]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:36:27.911333581 (72h8m3.950906701s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:36:27.911339763 (72h8m3.950912883s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:36:28.227564255 (72h8m4.267137375s) [upload=63482]: Done uploading segments... Sep 9 13:36:28.227582680 (72h8m4.2671558s) [upload=63482]: Upload finished. err: <nil> Duration: 14.294298029s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...XX................X..........X...........................] duration: 17.467307966s FAIL (2025-09-09 13:56:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:36:24.699178170 (72h8m0.73875128s) [upload=63482]: Starting upload Sep 9 13:36:24.699248395 (72h8m0.738821515s) [upload=63482]: Done starting upload Sep 9 13:36:24.699369106 (72h8m0.738942226s) [upload=63482]: Uploading segments... Sep 9 13:36:24.699446644 (72h8m0.739019764s) [upload=63482]: Got next segment. Inline: false Sep 9 13:36:24.699475770 (72h8m0.73904889s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:36:24.699480779 (72h8m0.739053899s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:36:24.952807291 (72h8m0.992380411s) [seg_pos={0 0}, upload=63482]: Begin upload segment... Sep 9 13:36:24.952868047 (72h8m0.992441167s) [seg_pos={0 0}, upload=63482]: Done begin upload segment. Sep 9 13:36:24.952898024 (72h8m0.992471144s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.952910428 (72h8m0.992483548s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953331383 (72h8m0.992904503s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953461392 (72h8m0.993034512s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953618634 (72h8m0.993191754s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953996036 (72h8m0.993569156s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954288655 (72h8m0.993861775s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954717907 (72h8m0.994291027s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954832666 (72h8m0.994405796s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955238142 (72h8m0.994811272s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955632758 (72h8m0.995205878s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955882025 (72h8m0.995455145s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956205935 (72h8m0.995779055s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956470330 (72h8m0.99604345s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956744094 (72h8m0.996317214s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.957199616 (72h8m0.996772736s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:26.711484588 (72h8m2.751057718s) [upload=63482]: Next returned nil segment Sep 9 13:36:26.711510889 (72h8m2.751084019s) [upload=63482]: Waiting for error group managing segments... Sep 9 13:36:27.118203368 (72h8m3.157776488s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.126206664 (72h8m3.165779794s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.171414553 (72h8m3.210987693s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.179550181 (72h8m3.219123301s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.191175036 (72h8m3.230748156s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206756021 (72h8m3.246329172s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206944202 (72h8m3.246517322s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.213110421 (72h8m3.252683541s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.258260740 (72h8m3.29783386s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.290952699 (72h8m3.330525829s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.322648582 (72h8m3.362221702s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.611398359 (72h8m3.650971479s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910860115 (72h8m3.950433235s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910886365 (72h8m3.950459485s) [seg_pos={0 0}, upload=63482]: Segment reached optimal threshold of 13 pieces. Sep 9 13:36:27.911001385 (72h8m3.950574505s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911164327 (72h8m3.950737447s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911216317 (72h8m3.950789437s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911253397 (72h8m3.950826517s) [seg_pos={0 0}, upload=63482]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:36:27.911333581 (72h8m3.950906701s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:36:27.911339763 (72h8m3.950912883s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:36:28.227564255 (72h8m4.267137375s) [upload=63482]: Done uploading segments... Sep 9 13:36:28.227582680 (72h8m4.2671558s) [upload=63482]: Upload finished. err: <nil> Duration: 17.467326812s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....XX................X..........X..........................] duration: 25.302503843s FAIL (2025-09-09 13:55:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:36:24.699178170 (72h8m0.73875128s) [upload=63482]: Starting upload Sep 9 13:36:24.699248395 (72h8m0.738821515s) [upload=63482]: Done starting upload Sep 9 13:36:24.699369106 (72h8m0.738942226s) [upload=63482]: Uploading segments... Sep 9 13:36:24.699446644 (72h8m0.739019764s) [upload=63482]: Got next segment. Inline: false Sep 9 13:36:24.699475770 (72h8m0.73904889s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:36:24.699480779 (72h8m0.739053899s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:36:24.952807291 (72h8m0.992380411s) [seg_pos={0 0}, upload=63482]: Begin upload segment... Sep 9 13:36:24.952868047 (72h8m0.992441167s) [seg_pos={0 0}, upload=63482]: Done begin upload segment. Sep 9 13:36:24.952898024 (72h8m0.992471144s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.952910428 (72h8m0.992483548s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953331383 (72h8m0.992904503s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953461392 (72h8m0.993034512s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953618634 (72h8m0.993191754s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953996036 (72h8m0.993569156s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954288655 (72h8m0.993861775s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954717907 (72h8m0.994291027s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954832666 (72h8m0.994405796s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955238142 (72h8m0.994811272s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955632758 (72h8m0.995205878s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955882025 (72h8m0.995455145s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956205935 (72h8m0.995779055s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956470330 (72h8m0.99604345s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956744094 (72h8m0.996317214s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.957199616 (72h8m0.996772736s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:26.711484588 (72h8m2.751057718s) [upload=63482]: Next returned nil segment Sep 9 13:36:26.711510889 (72h8m2.751084019s) [upload=63482]: Waiting for error group managing segments... Sep 9 13:36:27.118203368 (72h8m3.157776488s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.126206664 (72h8m3.165779794s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.171414553 (72h8m3.210987693s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.179550181 (72h8m3.219123301s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.191175036 (72h8m3.230748156s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206756021 (72h8m3.246329172s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206944202 (72h8m3.246517322s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.213110421 (72h8m3.252683541s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.258260740 (72h8m3.29783386s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.290952699 (72h8m3.330525829s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.322648582 (72h8m3.362221702s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.611398359 (72h8m3.650971479s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910860115 (72h8m3.950433235s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910886365 (72h8m3.950459485s) [seg_pos={0 0}, upload=63482]: Segment reached optimal threshold of 13 pieces. Sep 9 13:36:27.911001385 (72h8m3.950574505s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911164327 (72h8m3.950737447s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911216317 (72h8m3.950789437s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911253397 (72h8m3.950826517s) [seg_pos={0 0}, upload=63482]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:36:27.911333581 (72h8m3.950906701s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:36:27.911339763 (72h8m3.950912883s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:36:28.227564255 (72h8m4.267137375s) [upload=63482]: Done uploading segments... Sep 9 13:36:28.227582680 (72h8m4.2671558s) [upload=63482]: Upload finished. err: <nil> Duration: 25.302523191s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X....XX................X..........X.........................] duration: 19.56632969s FAIL (2025-09-09 13:54:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:36:24.699178170 (72h8m0.73875128s) [upload=63482]: Starting upload Sep 9 13:36:24.699248395 (72h8m0.738821515s) [upload=63482]: Done starting upload Sep 9 13:36:24.699369106 (72h8m0.738942226s) [upload=63482]: Uploading segments... Sep 9 13:36:24.699446644 (72h8m0.739019764s) [upload=63482]: Got next segment. Inline: false Sep 9 13:36:24.699475770 (72h8m0.73904889s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:36:24.699480779 (72h8m0.739053899s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:36:24.952807291 (72h8m0.992380411s) [seg_pos={0 0}, upload=63482]: Begin upload segment... Sep 9 13:36:24.952868047 (72h8m0.992441167s) [seg_pos={0 0}, upload=63482]: Done begin upload segment. Sep 9 13:36:24.952898024 (72h8m0.992471144s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.952910428 (72h8m0.992483548s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953331383 (72h8m0.992904503s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953461392 (72h8m0.993034512s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953618634 (72h8m0.993191754s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953996036 (72h8m0.993569156s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954288655 (72h8m0.993861775s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954717907 (72h8m0.994291027s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954832666 (72h8m0.994405796s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955238142 (72h8m0.994811272s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955632758 (72h8m0.995205878s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955882025 (72h8m0.995455145s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956205935 (72h8m0.995779055s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956470330 (72h8m0.99604345s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956744094 (72h8m0.996317214s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.957199616 (72h8m0.996772736s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:26.711484588 (72h8m2.751057718s) [upload=63482]: Next returned nil segment Sep 9 13:36:26.711510889 (72h8m2.751084019s) [upload=63482]: Waiting for error group managing segments... Sep 9 13:36:27.118203368 (72h8m3.157776488s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.126206664 (72h8m3.165779794s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.171414553 (72h8m3.210987693s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.179550181 (72h8m3.219123301s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.191175036 (72h8m3.230748156s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206756021 (72h8m3.246329172s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206944202 (72h8m3.246517322s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.213110421 (72h8m3.252683541s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.258260740 (72h8m3.29783386s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.290952699 (72h8m3.330525829s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.322648582 (72h8m3.362221702s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.611398359 (72h8m3.650971479s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910860115 (72h8m3.950433235s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910886365 (72h8m3.950459485s) [seg_pos={0 0}, upload=63482]: Segment reached optimal threshold of 13 pieces. Sep 9 13:36:27.911001385 (72h8m3.950574505s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911164327 (72h8m3.950737447s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911216317 (72h8m3.950789437s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911253397 (72h8m3.950826517s) [seg_pos={0 0}, upload=63482]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:36:27.911333581 (72h8m3.950906701s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:36:27.911339763 (72h8m3.950912883s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:36:28.227564255 (72h8m4.267137375s) [upload=63482]: Done uploading segments... Sep 9 13:36:28.227582680 (72h8m4.2671558s) [upload=63482]: Upload finished. err: <nil> Duration: 19.566370768s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X....XX................X..........X........................] duration: 26.20985412s FAIL (2025-09-09 13:54:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:36:24.699178170 (72h8m0.73875128s) [upload=63482]: Starting upload Sep 9 13:36:24.699248395 (72h8m0.738821515s) [upload=63482]: Done starting upload Sep 9 13:36:24.699369106 (72h8m0.738942226s) [upload=63482]: Uploading segments... Sep 9 13:36:24.699446644 (72h8m0.739019764s) [upload=63482]: Got next segment. Inline: false Sep 9 13:36:24.699475770 (72h8m0.73904889s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:36:24.699480779 (72h8m0.739053899s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:36:24.952807291 (72h8m0.992380411s) [seg_pos={0 0}, upload=63482]: Begin upload segment... Sep 9 13:36:24.952868047 (72h8m0.992441167s) [seg_pos={0 0}, upload=63482]: Done begin upload segment. Sep 9 13:36:24.952898024 (72h8m0.992471144s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.952910428 (72h8m0.992483548s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953331383 (72h8m0.992904503s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953461392 (72h8m0.993034512s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953618634 (72h8m0.993191754s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953996036 (72h8m0.993569156s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954288655 (72h8m0.993861775s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954717907 (72h8m0.994291027s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954832666 (72h8m0.994405796s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955238142 (72h8m0.994811272s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955632758 (72h8m0.995205878s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955882025 (72h8m0.995455145s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956205935 (72h8m0.995779055s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956470330 (72h8m0.99604345s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956744094 (72h8m0.996317214s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.957199616 (72h8m0.996772736s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:26.711484588 (72h8m2.751057718s) [upload=63482]: Next returned nil segment Sep 9 13:36:26.711510889 (72h8m2.751084019s) [upload=63482]: Waiting for error group managing segments... Sep 9 13:36:27.118203368 (72h8m3.157776488s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.126206664 (72h8m3.165779794s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.171414553 (72h8m3.210987693s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.179550181 (72h8m3.219123301s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.191175036 (72h8m3.230748156s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206756021 (72h8m3.246329172s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206944202 (72h8m3.246517322s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.213110421 (72h8m3.252683541s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.258260740 (72h8m3.29783386s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.290952699 (72h8m3.330525829s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.322648582 (72h8m3.362221702s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.611398359 (72h8m3.650971479s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910860115 (72h8m3.950433235s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910886365 (72h8m3.950459485s) [seg_pos={0 0}, upload=63482]: Segment reached optimal threshold of 13 pieces. Sep 9 13:36:27.911001385 (72h8m3.950574505s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911164327 (72h8m3.950737447s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911216317 (72h8m3.950789437s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911253397 (72h8m3.950826517s) [seg_pos={0 0}, upload=63482]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:36:27.911333581 (72h8m3.950906701s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:36:27.911339763 (72h8m3.950912883s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:36:28.227564255 (72h8m4.267137375s) [upload=63482]: Done uploading segments... Sep 9 13:36:28.227582680 (72h8m4.2671558s) [upload=63482]: Upload finished. err: <nil> Duration: 26.209908815s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X....XX................X..........X.......................] duration: 29.44113987s FAIL (2025-09-09 13:53:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:36:24.699178170 (72h8m0.73875128s) [upload=63482]: Starting upload Sep 9 13:36:24.699248395 (72h8m0.738821515s) [upload=63482]: Done starting upload Sep 9 13:36:24.699369106 (72h8m0.738942226s) [upload=63482]: Uploading segments... Sep 9 13:36:24.699446644 (72h8m0.739019764s) [upload=63482]: Got next segment. Inline: false Sep 9 13:36:24.699475770 (72h8m0.73904889s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:36:24.699480779 (72h8m0.739053899s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:36:24.952807291 (72h8m0.992380411s) [seg_pos={0 0}, upload=63482]: Begin upload segment... Sep 9 13:36:24.952868047 (72h8m0.992441167s) [seg_pos={0 0}, upload=63482]: Done begin upload segment. Sep 9 13:36:24.952898024 (72h8m0.992471144s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.952910428 (72h8m0.992483548s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953331383 (72h8m0.992904503s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953461392 (72h8m0.993034512s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953618634 (72h8m0.993191754s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953996036 (72h8m0.993569156s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954288655 (72h8m0.993861775s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954717907 (72h8m0.994291027s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954832666 (72h8m0.994405796s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955238142 (72h8m0.994811272s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955632758 (72h8m0.995205878s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955882025 (72h8m0.995455145s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956205935 (72h8m0.995779055s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956470330 (72h8m0.99604345s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956744094 (72h8m0.996317214s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.957199616 (72h8m0.996772736s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:26.711484588 (72h8m2.751057718s) [upload=63482]: Next returned nil segment Sep 9 13:36:26.711510889 (72h8m2.751084019s) [upload=63482]: Waiting for error group managing segments... Sep 9 13:36:27.118203368 (72h8m3.157776488s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.126206664 (72h8m3.165779794s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.171414553 (72h8m3.210987693s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.179550181 (72h8m3.219123301s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.191175036 (72h8m3.230748156s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206756021 (72h8m3.246329172s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206944202 (72h8m3.246517322s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.213110421 (72h8m3.252683541s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.258260740 (72h8m3.29783386s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.290952699 (72h8m3.330525829s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.322648582 (72h8m3.362221702s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.611398359 (72h8m3.650971479s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910860115 (72h8m3.950433235s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910886365 (72h8m3.950459485s) [seg_pos={0 0}, upload=63482]: Segment reached optimal threshold of 13 pieces. Sep 9 13:36:27.911001385 (72h8m3.950574505s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911164327 (72h8m3.950737447s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911216317 (72h8m3.950789437s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911253397 (72h8m3.950826517s) [seg_pos={0 0}, upload=63482]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:36:27.911333581 (72h8m3.950906701s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:36:27.911339763 (72h8m3.950912883s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:36:28.227564255 (72h8m4.267137375s) [upload=63482]: Done uploading segments... Sep 9 13:36:28.227582680 (72h8m4.2671558s) [upload=63482]: Upload finished. err: <nil> Duration: 29.441166862s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X....XX................X..........X......................] duration: 19.004343977s FAIL (2025-09-09 13:52:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:36:24.699178170 (72h8m0.73875128s) [upload=63482]: Starting upload Sep 9 13:36:24.699248395 (72h8m0.738821515s) [upload=63482]: Done starting upload Sep 9 13:36:24.699369106 (72h8m0.738942226s) [upload=63482]: Uploading segments... Sep 9 13:36:24.699446644 (72h8m0.739019764s) [upload=63482]: Got next segment. Inline: false Sep 9 13:36:24.699475770 (72h8m0.73904889s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:36:24.699480779 (72h8m0.739053899s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:36:24.952807291 (72h8m0.992380411s) [seg_pos={0 0}, upload=63482]: Begin upload segment... Sep 9 13:36:24.952868047 (72h8m0.992441167s) [seg_pos={0 0}, upload=63482]: Done begin upload segment. Sep 9 13:36:24.952898024 (72h8m0.992471144s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.952910428 (72h8m0.992483548s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953331383 (72h8m0.992904503s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953461392 (72h8m0.993034512s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953618634 (72h8m0.993191754s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953996036 (72h8m0.993569156s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954288655 (72h8m0.993861775s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954717907 (72h8m0.994291027s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954832666 (72h8m0.994405796s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955238142 (72h8m0.994811272s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955632758 (72h8m0.995205878s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955882025 (72h8m0.995455145s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956205935 (72h8m0.995779055s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956470330 (72h8m0.99604345s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956744094 (72h8m0.996317214s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.957199616 (72h8m0.996772736s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:26.711484588 (72h8m2.751057718s) [upload=63482]: Next returned nil segment Sep 9 13:36:26.711510889 (72h8m2.751084019s) [upload=63482]: Waiting for error group managing segments... Sep 9 13:36:27.118203368 (72h8m3.157776488s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.126206664 (72h8m3.165779794s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.171414553 (72h8m3.210987693s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.179550181 (72h8m3.219123301s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.191175036 (72h8m3.230748156s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206756021 (72h8m3.246329172s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206944202 (72h8m3.246517322s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.213110421 (72h8m3.252683541s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.258260740 (72h8m3.29783386s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.290952699 (72h8m3.330525829s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.322648582 (72h8m3.362221702s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.611398359 (72h8m3.650971479s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910860115 (72h8m3.950433235s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910886365 (72h8m3.950459485s) [seg_pos={0 0}, upload=63482]: Segment reached optimal threshold of 13 pieces. Sep 9 13:36:27.911001385 (72h8m3.950574505s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911164327 (72h8m3.950737447s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911216317 (72h8m3.950789437s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911253397 (72h8m3.950826517s) [seg_pos={0 0}, upload=63482]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:36:27.911333581 (72h8m3.950906701s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:36:27.911339763 (72h8m3.950912883s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:36:28.227564255 (72h8m4.267137375s) [upload=63482]: Done uploading segments... Sep 9 13:36:28.227582680 (72h8m4.2671558s) [upload=63482]: Upload finished. err: <nil> Duration: 19.004373063s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [X...X....XX................X..........X.....................] duration: 13.133802529s FAIL (2025-09-09 13:51:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 9 13:36:24.699178170 (72h8m0.73875128s) [upload=63482]: Starting upload Sep 9 13:36:24.699248395 (72h8m0.738821515s) [upload=63482]: Done starting upload Sep 9 13:36:24.699369106 (72h8m0.738942226s) [upload=63482]: Uploading segments... Sep 9 13:36:24.699446644 (72h8m0.739019764s) [upload=63482]: Got next segment. Inline: false Sep 9 13:36:24.699475770 (72h8m0.73904889s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 9 13:36:24.699480779 (72h8m0.739053899s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 9 13:36:24.952807291 (72h8m0.992380411s) [seg_pos={0 0}, upload=63482]: Begin upload segment... Sep 9 13:36:24.952868047 (72h8m0.992441167s) [seg_pos={0 0}, upload=63482]: Done begin upload segment. Sep 9 13:36:24.952898024 (72h8m0.992471144s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.952910428 (72h8m0.992483548s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953331383 (72h8m0.992904503s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953461392 (72h8m0.993034512s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953618634 (72h8m0.993191754s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.953996036 (72h8m0.993569156s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954288655 (72h8m0.993861775s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954717907 (72h8m0.994291027s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.954832666 (72h8m0.994405796s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955238142 (72h8m0.994811272s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955632758 (72h8m0.995205878s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.955882025 (72h8m0.995455145s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956205935 (72h8m0.995779055s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956470330 (72h8m0.99604345s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.956744094 (72h8m0.996317214s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:24.957199616 (72h8m0.996772736s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Uploading piece... Sep 9 13:36:26.711484588 (72h8m2.751057718s) [upload=63482]: Next returned nil segment Sep 9 13:36:26.711510889 (72h8m2.751084019s) [upload=63482]: Waiting for error group managing segments... Sep 9 13:36:27.118203368 (72h8m3.157776488s) [noise=true , address=45.91.116.4:4939 , piece_id=2SB5K6JIU4EKS3XJBSCLBKXI7M6VPZBO6FXTWO2VAAD3IYTY6IPA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.126206664 (72h8m3.165779794s) [noise=true , address=45.91.116.9:4262 , piece_id=GCB42XVWCKSTLIN7MGUWXTBUGSBIWIBDLTFA3W6JPCRMWZP6BDSA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.171414553 (72h8m3.210987693s) [noise=true , address=45.91.116.14:4191 , piece_id=T6X25APOXXXVJETIBLD2SAEG2Q7AXI2L7YNNAT5JDWA2NTMHPTZA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.179550181 (72h8m3.219123301s) [noise=true , address=77.90.31.21:4879 , piece_id=U433OPX3A6DKEVRMWMFKLN4N2S2UK5P56C2FHYYHBLHRJCI4HQ3Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.191175036 (72h8m3.230748156s) [noise=true , address=77.90.31.10:4520 , piece_id=AP5RXZTAE4LYN26B35QL2LUAVBT7WPPZIRJD7ZV53GOA6XXRZWRQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206756021 (72h8m3.246329172s) [noise=true , address=145.79.227.15:4874 , piece_id=7NBLWXUQKS2I2X5AOBTFOHFEGUXXKVWQJLMQJHRBLPL52UBO6NUQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.206944202 (72h8m3.246517322s) [noise=true , address=145.79.227.6:4257 , piece_id=M7MKS5FWA3BCARM34D45YS475JUU2GDIGOZX3X5JI2KA34LOEUDA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.213110421 (72h8m3.252683541s) [noise=true , address=45.91.116.6:4973 , piece_id=3AJRPOYIJWTOLPXJ2ZFAFGEKDE3KN4BT7LE7F3USPHRKNBDRKLBQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.258260740 (72h8m3.29783386s) [noise=true , address=45.91.116.13:4153 , piece_id=VTS2JZ7VO2Z6P4E3GU3VTKJ6RZ3USK6NJRWFC24KWW4HCFHBEOCA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.290952699 (72h8m3.330525829s) [noise=true , address=145.79.227.15:4876 , piece_id=2IY5LE4M2O7S2BM3HI7RGDNJM7MYVJIZXM42RZPLTPLEWXQY3XHQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.322648582 (72h8m3.362221702s) [noise=true , address=145.79.227.19:4079 , piece_id=JNQBCLEN2FCJO4SJVQWIVFPLJ6OXMFIBL5LQAEJ6UEAJWEKGJALA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.611398359 (72h8m3.650971479s) [noise=true , address=77.90.31.15:4698 , piece_id=QRGSYQQBUXMLZQPI3AZQPEKWVVZNTDIASCK5J5LYLVGBMVFWTAHA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910860115 (72h8m3.950433235s) [noise=true , address=45.91.116.10:4081 , piece_id=CONOAMOUAPWA6DHDUTXDLCNJEFPICTUJX65AIQRTKX6N6CMYWFEQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: <nil> Sep 9 13:36:27.910886365 (72h8m3.950459485s) [seg_pos={0 0}, upload=63482]: Segment reached optimal threshold of 13 pieces. Sep 9 13:36:27.911001385 (72h8m3.950574505s) [noise=true , address=45.91.116.11:4119 , piece_id=JNQTS7H7ACL3U5IPWGH3JJBSON4UDEOIRY4K2MYQ3K5K5XGKXSWQ, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911164327 (72h8m3.950737447s) [noise=true , address=45.91.116.12:4226 , piece_id=PK74YANURWY2FKZXXGS34C4D4LHVZ54O2DDUDCEH6CRFPVJZRUNA, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911216317 (72h8m3.950789437s) [noise=true , address=77.90.31.16:4733 , piece_id=QN7DF4UDA6SJ5YUJ3VN3LT7EVDDMQV4G6NH6R75EILCOQGRLVS4Q, seg_pos={0 0}, upload=63482]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: expected piece hash; context canceled; EOF Sep 9 13:36:27.911253397 (72h8m3.950826517s) [seg_pos={0 0}, upload=63482]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 9 13:36:27.911333581 (72h8m3.950906701s) [upload=63482]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 9 13:36:27.911339763 (72h8m3.950912883s) [upload=63482]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 9 13:36:28.227564255 (72h8m4.267137375s) [upload=63482]: Done uploading segments... Sep 9 13:36:28.227582680 (72h8m4.2671558s) [upload=63482]: Upload finished. err: <nil> Duration: 13.133828869s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)